-- Logs begin at Wed 2021-09-15 07:56:53 UTC, end at Wed 2021-09-15 09:27:13 UTC. -- Sep 15 08:48:43.334296 dv-cinder-806008-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 08:48:43.342958 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 15 08:48:43 2021] *** Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: nodename: dv-cinder-806008-2-iscsi Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: machine: x86_64 Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: clock source: unix Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: pcre jit disabled Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: detected number of CPU cores: 4 Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: current working directory: / Sep 15 08:48:43.344799 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: detected binary path: /usr/bin/uwsgi-core Sep 15 08:48:43.345488 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: your processes number limit is 47680 Sep 15 08:48:43.345488 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: your memory page size is 4096 bytes Sep 15 08:48:43.345488 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: detected max file descriptor number: 2048 Sep 15 08:48:43.345488 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: lock engine: pthread robust mutexes Sep 15 08:48:43.345488 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: thunder lock: enabled Sep 15 08:48:43.345488 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 08:48:43.345488 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 15 08:48:43.385145 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: Python main interpreter initialized at 0x5639202789c0 Sep 15 08:48:43.385145 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: python threads support enabled Sep 15 08:48:43.385145 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: your server socket listen backlog is limited to 100 connections Sep 15 08:48:43.385145 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: your mercy for graceful operations on workers is 90 seconds Sep 15 08:48:43.385467 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 08:48:43.385539 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: *** Operational MODE: preforking *** Sep 15 08:48:43.385794 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: *** uWSGI is running in multiple interpreter mode *** Sep 15 08:48:43.385794 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: spawned uWSGI master process (pid: 75145) Sep 15 08:48:43.385975 dv-cinder-806008-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 08:48:43.387100 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: spawned uWSGI worker 1 (pid: 75146, cores: 1) Sep 15 08:48:43.387100 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: spawned uWSGI worker 2 (pid: 75147, cores: 1) Sep 15 08:48:43.387100 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 08:48:47.397097 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 08:48:47.397812 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 08:48:47.397898 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 08:48:47.398294 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 08:48:47.398364 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 08:48:47.398447 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 08:48:47.398447 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 08:48:47.398585 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 08:48:47.398712 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 08:48:47.398846 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.398954 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 08:48:47.399041 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.399336 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.399436 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.399659 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.399746 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.399973 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.400069 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.400291 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.400376 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.400601 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.400695 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.400914 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.401013 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.401229 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.401323 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.401532 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.401614 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.401846 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.401939 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.402115 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.402211 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.402439 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.402542 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.402745 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.402839 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806008-2-iscsi {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.403059 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.403147 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.403365 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.403469 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806008-2-iscsi {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.403678 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.403772 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.403979 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.404071 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.404282 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.404376 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.404598 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.404724 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.404899 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.405023 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.405215 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.405400 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.405543 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.405843 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.406008 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.406178 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.406336 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.406490 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.406640 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.406832 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.406960 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.407152 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.407287 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.407461 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.407589 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.407783 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.407916 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.408121 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.408248 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.408448 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.408580 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.408758 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.408878 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.409065 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.409199 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806008-2-iscsi {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.409382 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806008-2-iscsi {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.409508 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.409689 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.409822 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.409994 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.410138 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.410329 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.410457 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.410746 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.410845 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.411039 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.411136 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.411348 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.411435 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.411664 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.411760 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.411974 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.412071 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.412284 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.412460 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.412607 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.412769 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.412907 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.413043 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.413208 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.413363 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.413513 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.413649 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.413785 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.413920 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.414119 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.414268 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.414418 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.414564 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.414727 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.414877 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.415024 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.415161 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.415310 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.415447 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.415583 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.415718 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.415877 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.416024 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.416170 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.416307 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.416452 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.416590 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.416730 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.416879 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.417019 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.417170 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.417308 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.417444 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.417581 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.417728 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.417875 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.418020 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.418185 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.418323 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.418471 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.418609 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.418752 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.418889 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.419034 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.419176 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.419322 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.419459 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.419602 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.419757 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.419894 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.420029 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.420185 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.420322 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.420468 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.420611 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.420755 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.420890 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.421039 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.421175 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.421317 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.421459 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.421606 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.421811 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.421999 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.422172 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.422346 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.422490 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.422651 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.422808 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.422985 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.423139 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.423284 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.423427 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.423590 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.424241 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.424418 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.424570 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.424707 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.424842 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.425016 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.425242 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.425380 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.425514 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.425663 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.425798 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.425948 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.426120 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.426276 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.426413 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.426548 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.426683 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.426830 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.426972 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.427109 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.427245 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.427387 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.427524 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.427669 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.427812 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.427966 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.428103 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.428239 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.428374 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.428521 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.428657 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.428792 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.428927 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.429063 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.429198 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.429342 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.429478 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.429614 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.429764 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.429901 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.430045 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.430212 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.430349 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.430517 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.430670 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.430807 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.430951 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.431111 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.431261 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.431398 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.431533 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.431714 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.431868 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.432030 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.432173 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.432333 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.432475 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.432618 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.432764 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.432930 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.433080 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.433222 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.433366 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.433535 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.433688 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.433832 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.433975 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.434145 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.434293 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.434454 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.434608 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.434745 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.434880 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.435040 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.435197 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.435337 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.435482 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.435643 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.435785 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.435928 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.436076 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.436219 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.436368 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.436505 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.436641 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.436797 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.436940 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.437110 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.437262 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.437405 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.437556 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.437692 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.437838 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.437983 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.438176 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.438320 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.438467 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.438606 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.438750 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.438899 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.439043 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.439179 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.439929 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.440092 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.440231 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.440376 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.440512 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.440676 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.440815 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.440950 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.441086 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.441231 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.441367 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.441503 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.441647 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.441784 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.441941 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.442101 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:48:47.442247 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.442393 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.442530 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.442697 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.442854 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.443039 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.443182 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.443349 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.443498 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.443677 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.443846 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.443991 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.444128 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.444313 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.444462 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.444615 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.444757 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.444916 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.445060 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.445237 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.445380 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.445535 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.445672 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.445825 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.445963 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.446135 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.446292 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.446442 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.446579 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.446755 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.446900 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.447080 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.447230 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.447382 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.447525 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.447761 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.447909 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.448047 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.448185 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.448330 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.448474 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.448617 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.448761 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.448897 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.449034 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.449180 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.449326 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.449463 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.449614 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.449801 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.449945 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.450173 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.450334 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.450472 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.450609 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.450798 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.450950 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.451097 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.451234 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.451411 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.451561 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.451712 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.451857 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.452019 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.452170 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.452315 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.452459 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.452623 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.452774 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.452936 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.453080 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.453253 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.453394 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.453564 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.453723 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.453860 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.453995 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.454185 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.454340 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.454485 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.454632 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.454769 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.454939 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.455082 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.455225 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.455397 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.455546 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.455703 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.455841 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.456022 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.456164 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.456310 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.456447 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.456637 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.456789 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.456933 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.457071 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.457237 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.457382 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.457528 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.457664 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.457832 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.457984 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.458164 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.458307 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.458451 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.458588 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.458731 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.458877 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.459048 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.459199 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.459337 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.459483 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.459626 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.459772 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.459943 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.460094 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.460232 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.460369 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.460531 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.460689 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.460828 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.460972 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.461137 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.461280 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.461434 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.461587 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.462277 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.462439 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.462579 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.462718 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.462864 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.463001 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.463146 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.463290 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.463434 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.463579 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.463729 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.463877 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464014 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464151 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464288 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464425 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464571 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464710 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464847 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.464983 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.465119 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.465255 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.465400 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.465537 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.465694 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.465838 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.465976 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.466140 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.466293 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.466430 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.466574 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.466711 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.466849 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.466994 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.467139 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.467276 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.467412 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.467562 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.467698 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.467842 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.467987 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.468131 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.468267 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.468410 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.468547 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.468692 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.468830 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.468973 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.469111 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.469256 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.469393 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.469538 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.469676 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.469812 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.469948 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.470117 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.470261 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.470413 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.470578 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.470716 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.470852 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.470995 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.471155 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.471293 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.471428 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.471571 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.471708 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.471844 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.471988 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.472132 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.472284 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.472421 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.472557 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.472726 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.472878 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.473051 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.473196 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.473368 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.473512 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.473680 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.473902 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.474041 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.474206 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.474344 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.474479 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.474614 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.474766 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.474904 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.475050 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.475192 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.475330 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.475478 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.475625 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.475788 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.475931 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.476117 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.476269 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.476415 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.476559 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.476728 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.476872 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.477039 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.477189 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.477340 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.477477 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.477612 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.477748 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.477913 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.478056 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.478256 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.478403 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.478540 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.478676 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.478812 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.478964 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.479114 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.479257 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.479401 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.479550 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.479688 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.480114 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.480279 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.480422 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.480606 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.480750 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.480894 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.481040 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.481193 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.481330 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.481510 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.481653 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.481811 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.481963 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.482134 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.482277 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.482414 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.482551 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.482728 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.482884 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.483029 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.483175 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.483311 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.483448 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.483608 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.483760 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.483919 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.484069 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.484227 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.484370 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.484517 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.484656 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.484819 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.484971 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.485129 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.485271 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.485417 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.485561 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.485709 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.485878 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.486017 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.486714 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.486868 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.487006 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.487143 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.487279 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.487426 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.487563 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.487737 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.487891 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.488059 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.488203 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.488364 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.488515 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.488652 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.488795 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.488955 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.489099 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.489262 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.489424 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.489563 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.489699 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.489835 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.489980 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.490142 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.490316 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.490483 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.490627 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.490790 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.490941 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.491079 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.491229 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.491377 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.491513 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.491695 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.491838 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.492001 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.492154 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.492318 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.492457 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.492594 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.492736 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.492904 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.493049 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.493228 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.493389 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.493527 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.493672 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.493817 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.493954 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.494126 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.494297 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.494437 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.494581 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.494731 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.494869 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.495006 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.495143 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.495322 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.495467 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.495617 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.495760 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.495923 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.496067 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.496243 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.496391 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.496528 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.496671 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.496807 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.496942 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.497103 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.497266 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.497667 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.497810 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.497997 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.498170 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.498335 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.498495 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.498656 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.498798 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.498968 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.499112 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.499284 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.499447 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.499614 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.499756 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.499935 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.500077 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.500246 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.500397 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.500535 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.500678 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.500839 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.500982 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.501128 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.501265 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.501412 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.501549 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.501721 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.502434 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.502592 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.502736 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.502874 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.503010 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.503171 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.503321 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.503487 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.503626 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.503763 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.503917 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.504054 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.504190 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.504356 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.504506 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.504644 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.504787 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.504953 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.505112 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.505256 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.505398 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.505546 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.505690 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.505842 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.505998 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.506174 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.506323 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.506479 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.506627 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.506771 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.506927 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.507088 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.507240 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.507391 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.507534 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.507676 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.507837 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.507981 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.508124 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.508275 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.508419 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.508563 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.508712 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.508879 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.509039 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.509184 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.509326 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.509468 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.509620 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.509770 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.509923 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.510067 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.510278 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.510431 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.510574 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.510717 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.510870 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.511021 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.511171 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.511315 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.511458 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.511612 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.511764 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.511909 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.512052 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.512194 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.512337 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.512488 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.512631 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.512780 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.512924 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.513068 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.513210 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.513363 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.513520 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.513670 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.513821 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.513964 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.514131 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.514293 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.514439 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.514583 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.514725 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.514874 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.515024 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.515182 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.515340 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.515493 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.515642 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.515795 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.515938 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.516093 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.516237 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.516387 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.516534 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.516677 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.516834 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.516978 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.517120 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.517263 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.517441 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.517587 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.517743 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.517888 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518037 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518218 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518362 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518516 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518657 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518758 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518843 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.518924 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.519116 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.519208 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.519422 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.519514 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.519734 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.519832 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.520033 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.520121 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.520335 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.520426 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.520637 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.520726 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.520935 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.521031 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.521236 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.521323 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.521549 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.521647 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.521850 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.521947 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.522174 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.522280 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.522487 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.522584 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.522781 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.522878 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.523106 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.523192 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.523421 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.523527 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.523755 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.523868 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.524070 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.524168 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.524383 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.524470 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.524690 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.524786 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.524993 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.525082 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.525300 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.525386 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.525605 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.525693 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.525914 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.526000 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.526239 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.526329 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.526543 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.526633 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.526847 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.526933 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.527156 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.527243 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.527463 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.527552 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.527779 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.527866 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.528097 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.528184 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.528417 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.528519 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.528720 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.528821 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.529022 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.529119 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.529329 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.529423 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.529636 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.529732 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.529942 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.530048 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.530269 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.530359 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.530578 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.530666 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.530886 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.530987 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.531191 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.531279 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.531497 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.531598 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.531806 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.532077 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.532174 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.532255 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.532462 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.532552 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.532691 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.532789 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.533010 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.533098 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.533320 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.533427 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.533634 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.533726 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.533935 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.534031 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.534266 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.534357 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.534567 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.534664 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.534872 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.534959 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.535169 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.535255 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.535479 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.535587 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.535896 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.535983 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.536202 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.536290 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.536502 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.536592 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.536807 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.536894 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.537112 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.537212 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.537422 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.537511 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.537733 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.537821 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.538036 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.538157 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.538369 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.538476 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.538793 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.538900 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.539099 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.539272 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.539411 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.539502 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.539712 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.539807 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.540015 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.540173 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.540319 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.540414 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.540633 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.540721 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.540934 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.541033 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.541237 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.541326 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.541539 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.541627 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.541845 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.541940 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.542170 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.542262 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.542488 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.542578 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.542812 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.542916 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.543196 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.543295 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.543503 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.543616 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.543826 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.543923 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.544211 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.544302 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.544517 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.544615 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.544839 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.544928 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.545154 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.545243 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.545477 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.545577 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.545778 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.545868 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.546112 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.546205 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.546411 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.546581 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.546720 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.546825 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.547042 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.547132 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.547362 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.547459 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.547669 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.547757 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.547980 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.548068 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.548282 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.548382 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.548601 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.549243 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.549442 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.549541 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.549756 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.549844 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.550070 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.550208 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.550420 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.550568 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.550837 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.550926 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.551164 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.551252 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.551478 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.551565 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.551798 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.551904 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.552118 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.552208 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.552420 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.552507 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.552722 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.552812 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.553029 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.553118 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.553331 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.553431 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.553649 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.553790 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.553939 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.554034 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.554273 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.554385 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.554577 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.554665 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.554883 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.554972 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.555188 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.555284 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.555489 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.555577 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.555789 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.555876 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.556093 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.556190 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.556392 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.556479 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.556711 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.556804 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.557020 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.557116 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.557342 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.557511 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.557657 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.557745 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.557959 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.558048 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.558302 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.558404 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.558606 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.558694 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.558910 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.559010 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.559211 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.559353 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.559512 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.559602 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.559814 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.559909 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.560142 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.560232 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.560456 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.560544 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.560777 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.560867 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.561100 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.561190 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.561409 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.561504 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.561724 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.561818 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.562045 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.562153 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.562378 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.562467 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.562691 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.562796 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.563008 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.563097 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.563309 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.563403 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.563611 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.563708 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.563922 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.564010 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.564219 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.564871 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.565084 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.565185 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.565395 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.565484 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.565699 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.565785 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.566003 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.566120 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.566331 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.566419 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.566631 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.566721 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.566934 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.567029 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.567243 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.567331 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.567555 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.567643 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.567862 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.567960 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.568169 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.568259 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.568471 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.568559 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.568772 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.568862 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.569075 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.569171 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.569402 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.569494 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.569714 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.569802 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.570032 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.570138 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.570376 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.570465 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.570699 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.570788 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.571002 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.571091 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.571324 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.571413 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.571638 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.571728 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.571950 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.572038 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.572261 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.572367 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.572571 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.572659 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.572880 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.572967 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.573190 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.573294 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.573504 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.573590 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.573811 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.573900 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.574139 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.574242 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.574452 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.574546 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.574765 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.574854 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.575080 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.575282 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.575605 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.575707 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.575932 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.576020 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.576245 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.576334 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.576556 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.576645 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.576867 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.576957 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.577178 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.577265 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.577485 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.577579 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.577794 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.577882 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.578121 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.578210 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.578434 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.578530 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.578744 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.578831 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.579054 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.579151 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.579377 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.579463 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.579703 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.579799 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.580065 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.580158 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.580377 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.580465 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.580689 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.580785 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.581000 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.581089 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.581315 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.581403 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.581632 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.581720 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.581969 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.582056 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.582298 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.582388 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.582612 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.582714 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.582929 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.583017 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.583242 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.583337 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.583554 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.583655 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.583869 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.583956 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.584178 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.584274 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.584491 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.584578 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.584797 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.584884 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.585106 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.585204 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.585414 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.585501 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.585722 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.585809 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.586033 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.586150 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.586388 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.586484 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.586704 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.586790 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.587014 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.587112 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.587341 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.587431 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.587635 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.587734 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.587953 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.588146 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.588457 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.588544 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.588777 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.588871 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.589100 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.589188 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.589422 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.589510 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.589735 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.589831 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.590046 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.590194 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.590376 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.590464 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.590679 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.590779 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.590981 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.591069 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.591286 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.591372 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.591590 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.591690 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.591892 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.591979 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.592197 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.592283 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.592499 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.592598 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.592799 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.592888 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.593103 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.593191 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.593406 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.593502 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.593723 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.593939 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.594284 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.594376 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.594604 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.594692 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.594926 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.595015 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.595249 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.595337 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.596084 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.596179 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.596390 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.596478 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.596705 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.596792 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.597009 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.597105 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.597312 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.597400 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.597622 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.597710 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.597927 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.598028 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.598271 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.598361 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.598582 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.598684 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.598891 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.598981 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.599203 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.599291 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.599506 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.599604 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.599811 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.599903 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.600110 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.600197 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.600416 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.600513 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.600720 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.600806 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.601022 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.601117 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.601324 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.601420 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.601626 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.601720 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.601924 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.602018 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.602247 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.602347 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.602549 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.602643 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.602849 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.602945 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.603156 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.603246 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.603475 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.603612 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.603760 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.603856 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.604061 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.604149 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.604369 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.604458 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.604667 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.605070 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.605256 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.605346 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.605558 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.605647 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.605864 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.605952 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.606193 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.606288 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.606501 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.606589 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.606806 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.606895 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.607112 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.607213 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.607425 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.607531 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.607730 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.607825 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.608038 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.608134 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.608354 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.608442 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.608682 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.608778 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.609007 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.609210 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.609542 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.609669 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.609859 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.609958 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.610208 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.610311 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.610548 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.610638 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.610854 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.610955 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.611720 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.611820 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.612034 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.612132 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.612341 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.612429 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.612650 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.612744 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.612960 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.613048 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.613269 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.613365 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.613578 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.613666 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.613888 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.613978 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.614223 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.614315 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.614538 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.614626 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.614846 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.614932 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.615154 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.615261 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.615461 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.615550 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.615773 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.615869 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.616101 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.616200 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.616415 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.616502 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.616727 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.616824 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.617039 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.617127 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.617347 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.617434 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.617654 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.617819 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.617943 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.618038 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.618276 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.618377 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.618588 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.618686 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.618915 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.619004 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.619221 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.619309 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.619524 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.619619 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.619845 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.620108 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.620421 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.620509 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.620736 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.620830 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.621054 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.621142 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.621364 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.621453 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.621679 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.621767 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.622014 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.622153 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.622367 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.622469 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.622695 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.622788 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.623001 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.623097 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.623351 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.623459 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.623610 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.623699 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.623914 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.624001 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.624226 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.624325 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.624553 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.624641 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.624869 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.624956 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.625179 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.625268 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.625496 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.625583 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.625803 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.625890 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.626141 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.626233 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.626464 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.626554 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.626811 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.626899 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.627124 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.627214 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.627436 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.627523 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.627751 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.627838 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.628061 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.628151 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.628371 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.628460 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.628680 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.628781 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.628989 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.629078 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.629298 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.629388 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.629608 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.629704 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.629933 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.630067 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.630261 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.630352 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.630578 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.630674 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.630891 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.630985 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.631207 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.631295 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.631521 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.631617 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.631829 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.631918 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.632140 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.632227 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.632451 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.632540 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.632764 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.632897 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.633074 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.633163 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.633382 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.633469 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.633691 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.633785 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.634005 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.634113 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.634348 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.634439 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.634668 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.634755 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.634990 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.635087 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.635312 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.635401 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.635637 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.635730 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.635945 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.636041 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.636281 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.636369 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.636602 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.636689 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.636842 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=75147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 08:48:47.636943 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:48:47.637167 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=75146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 08:48:47.670958 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_db.sqlalchemy.engines [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:47.671514 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:47.912946 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.context [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e240028-fead-427e-81eb-96ea8b8203bc(cell1) {{(pid=75146) load_cells /opt/stack/nova/nova/context.py:465}} Sep 15 08:48:47.914335 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.context [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e240028-fead-427e-81eb-96ea8b8203bc(cell1) {{(pid=75147) load_cells /opt/stack/nova/nova/context.py:465}} Sep 15 08:48:47.917191 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:48:47.918533 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_concurrency.lockutils [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:48:47.918883 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:48:47.919706 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:48:47.926479 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_concurrency.lockutils [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=75147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:48:47.926479 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_concurrency.lockutils [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:48:47.926708 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:48:47.926830 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_concurrency.lockutils [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=75147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:48:47.947646 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_db.sqlalchemy.engines [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:47.950338 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:47.957168 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_db.sqlalchemy.engines [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:47.961170 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:47.984752 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_db.sqlalchemy.engines [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:47.985683 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:48:48.204625 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO keyring.backend [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Loading KWallet Sep 15 08:48:48.214445 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO keyring.backend [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Loading SecretService Sep 15 08:48:48.218357 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO keyring.backend [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Loading Windows Sep 15 08:48:48.220209 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO keyring.backend [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Loading chainer Sep 15 08:48:48.221647 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO keyring.backend [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Loading macOS Sep 15 08:48:48.228482 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO keyring.backend [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Loading KWallet Sep 15 08:48:48.237749 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO keyring.backend [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Loading SecretService Sep 15 08:48:48.241606 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO keyring.backend [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Loading Windows Sep 15 08:48:48.243479 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO keyring.backend [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Loading chainer Sep 15 08:48:48.244271 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO keyring.backend [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Loading macOS Sep 15 08:48:48.568607 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: WARNING keystonemiddleware.auth_token [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:48:48.575238 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: WARNING keystonemiddleware.auth_token [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:48:48.592290 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: WARNING keystonemiddleware.auth_token [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:48:48.598776 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: WARNING keystonemiddleware.auth_token [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:48:48.787984 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: WARNING keystonemiddleware.auth_token [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:48:48.793069 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: WARNING keystonemiddleware.auth_token [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:48:48.798301 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5639202789c0 pid: 75146 (default app) Sep 15 08:48:48.800890 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:48:48.801984 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-0fadf3ab-ac84-4ae2-b48f-9fd832227f53 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001636 Sep 15 08:48:48.802411 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 789 bytes} [Wed Sep 15 08:48:48 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:48:48.810242 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: WARNING keystonemiddleware.auth_token [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:48:48.816151 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: WARNING keystonemiddleware.auth_token [None req-9ffd9928-0353-4c9e-9777-b35c5fba8485 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:48:48.821487 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5639202789c0 pid: 75147 (default app) Sep 15 08:50:08.586998 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-532f1a5d-bca5-4ef4-93c8-1eb616ee7557 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:08.609999 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-532f1a5d-bca5-4ef4-93c8-1eb616ee7557 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.465709 Sep 15 08:50:08.610582 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1160 bytes} [Wed Sep 15 08:50:08 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:10.978368 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-a83d69ba-16ac-4d09-be10-0c5ad96eb72f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:11.001498 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:50:11.001498 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: warnings.warn(msg) Sep 15 08:50:11.083865 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-a83d69ba-16ac-4d09-be10-0c5ad96eb72f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.419332 Sep 15 08:50:11.084438 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 1/3] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:10 2021] POST /compute/v2.1/flavors => generated 367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:11.100389 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-04fdfe5f-58b4-47f6-9630-b0fe81077e32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:11.108259 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:50:11.108259 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: warnings.warn(msg) Sep 15 08:50:11.201901 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-04fdfe5f-58b4-47f6-9630-b0fe81077e32 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.110975 Sep 15 08:50:11.202501 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 3/4] 10.222.0.39 () {62 vars in 1246 bytes} [Wed Sep 15 08:50:11 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:11.217764 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-e9b986d8-cd87-4cf2-9419-0c1109093dc5 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:11.238925 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-e9b986d8-cd87-4cf2-9419-0c1109093dc5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030623 Sep 15 08:50:11.239360 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 2/5] 10.222.0.39 () {58 vars in 1193 bytes} [Wed Sep 15 08:50:11 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:13.356254 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-d4d8f7e7-3ce6-409d-8a84-63b5573995ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:13.378755 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:50:13.378755 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: warnings.warn(msg) Sep 15 08:50:13.618556 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-d4d8f7e7-3ce6-409d-8a84-63b5573995ae admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.338865 Sep 15 08:50:13.619129 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 4/6] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:13 2021] POST /compute/v2.1/flavors => generated 364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:13.634525 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-86f6a964-7eff-4e9f-a03f-75c502780d20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:13.640562 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:50:13.640562 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: warnings.warn(msg) Sep 15 08:50:13.753034 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-86f6a964-7eff-4e9f-a03f-75c502780d20 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.126843 Sep 15 08:50:13.753584 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 3/7] 10.222.0.39 () {62 vars in 1246 bytes} [Wed Sep 15 08:50:13 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:50:13.767312 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-9afd85c4-c640-4839-9dd4-1ab70ddabfc0 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:13.787787 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-9afd85c4-c640-4839-9dd4-1ab70ddabfc0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028725 Sep 15 08:50:13.788287 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1193 bytes} [Wed Sep 15 08:50:13 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:15.916126 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-41cce92f-fd83-4f26-af94-754efe573a06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:16.116551 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-41cce92f-fd83-4f26-af94-754efe573a06 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.276449 Sep 15 08:50:16.117141 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 4/9] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:15 2021] POST /compute/v2.1/flavors => generated 364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:16.132069 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-bb815b37-1337-4f59-8277-a6cb22c77390 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:16.342028 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-bb815b37-1337-4f59-8277-a6cb22c77390 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.218570 Sep 15 08:50:16.342631 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 6/10] 10.222.0.39 () {62 vars in 1246 bytes} [Wed Sep 15 08:50:16 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:16.357620 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-53cede03-92f1-4118-8daf-31c181beed3a admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:16.376339 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-53cede03-92f1-4118-8daf-31c181beed3a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027896 Sep 15 08:50:16.376791 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 5/11] 10.222.0.39 () {58 vars in 1193 bytes} [Wed Sep 15 08:50:16 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:18.493759 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-e872a032-7ab6-49c0-b12a-87ebf2cb6090 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:18.576283 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-e872a032-7ab6-49c0-b12a-87ebf2cb6090 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.159373 Sep 15 08:50:18.576826 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 7/12] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:18 2021] POST /compute/v2.1/flavors => generated 364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:18.591792 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-a8e6bde1-bb32-4324-8d39-faff7b280274 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:18.689624 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-a8e6bde1-bb32-4324-8d39-faff7b280274 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.106507 Sep 15 08:50:18.690126 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 6/13] 10.222.0.39 () {62 vars in 1246 bytes} [Wed Sep 15 08:50:18 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:50:18.704489 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-a25fdd1f-dcaa-4a76-8b65-0791b87c0274 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:18.723726 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-a25fdd1f-dcaa-4a76-8b65-0791b87c0274 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028087 Sep 15 08:50:18.724233 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 8/14] 10.222.0.39 () {58 vars in 1193 bytes} [Wed Sep 15 08:50:18 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:20.847051 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-d683f6b8-758f-48fb-a4fd-29d7437398eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:20.935901 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-d683f6b8-758f-48fb-a4fd-29d7437398eb admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.165448 Sep 15 08:50:20.936443 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 7/15] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:20 2021] POST /compute/v2.1/flavors => generated 364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:20.951659 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-77900ab8-df2d-4e35-bdff-0a83c24c4108 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:21.026385 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-77900ab8-df2d-4e35-bdff-0a83c24c4108 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.083479 Sep 15 08:50:21.026941 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 9/16] 10.222.0.39 () {62 vars in 1246 bytes} [Wed Sep 15 08:50:20 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:21.041392 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-3fa94f38-4232-4fdc-8665-6f1782e85a1c admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:21.060469 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-3fa94f38-4232-4fdc-8665-6f1782e85a1c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027478 Sep 15 08:50:21.060987 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1193 bytes} [Wed Sep 15 08:50:21 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:50:23.186691 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-ca741572-336e-45b0-9408-8b6458b29284 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:23.205043 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-ca741572-336e-45b0-9408-8b6458b29284 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.096291 Sep 15 08:50:23.205570 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 10/18] 10.222.0.39 () {58 vars in 1160 bytes} [Wed Sep 15 08:50:23 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:50:25.331636 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-05765cb4-7fe0-46ec-8f78-83be58815cd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:25.444127 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-05765cb4-7fe0-46ec-8f78-83be58815cd1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.188558 Sep 15 08:50:25.444624 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 9/19] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:25 2021] POST /compute/v2.1/flavors => generated 362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:25.461760 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-f8611179-957d-44a2-be0e-f76ca580841d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:25.541473 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-f8611179-957d-44a2-be0e-f76ca580841d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.090413 Sep 15 08:50:25.542072 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 11/20] 10.222.0.39 () {62 vars in 1243 bytes} [Wed Sep 15 08:50:25 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:25.557272 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-e11c7edf-f471-4854-a7cc-683989b25730 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:25.576867 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-e11c7edf-f471-4854-a7cc-683989b25730 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028589 Sep 15 08:50:25.577406 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 10/21] 10.222.0.39 () {58 vars in 1190 bytes} [Wed Sep 15 08:50:25 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:27.707185 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-34774f2e-9974-4cbe-8c47-51033ea8483a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:27.793211 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-34774f2e-9974-4cbe-8c47-51033ea8483a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.163018 Sep 15 08:50:27.793698 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 12/22] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:27 2021] POST /compute/v2.1/flavors => generated 365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:27.808342 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-bc9e6167-3f97-4af3-8307-b8e2ebbd1510 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:27.900074 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-bc9e6167-3f97-4af3-8307-b8e2ebbd1510 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.100007 Sep 15 08:50:27.900662 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 11/23] 10.222.0.39 () {62 vars in 1243 bytes} [Wed Sep 15 08:50:27 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:27.915133 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-a3863020-332c-49fd-858e-253f57736648 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:27.933818 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-a3863020-332c-49fd-858e-253f57736648 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027046 Sep 15 08:50:27.934356 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 13/24] 10.222.0.39 () {58 vars in 1190 bytes} [Wed Sep 15 08:50:27 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:30.112457 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-5915702a-3e05-443d-854c-027b2230c64d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:30.211179 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-5915702a-3e05-443d-854c-027b2230c64d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.176617 Sep 15 08:50:30.211700 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 12/25] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:30 2021] POST /compute/v2.1/flavors => generated 366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:30.226382 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-99e0e6c5-cfc9-476e-a5a2-91b723cd416f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:30.317621 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-99e0e6c5-cfc9-476e-a5a2-91b723cd416f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.099655 Sep 15 08:50:30.318202 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 14/26] 10.222.0.39 () {62 vars in 1243 bytes} [Wed Sep 15 08:50:30 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:30.332209 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-c3490958-bd03-42bc-994f-58f4df52d533 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:30.351797 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-c3490958-bd03-42bc-994f-58f4df52d533 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028085 Sep 15 08:50:30.352616 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 13/27] 10.222.0.39 () {58 vars in 1190 bytes} [Wed Sep 15 08:50:30 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:50:32.523056 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-b9cc1c0a-da9b-4ada-8bca-29c9c67cef5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:32.597524 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-b9cc1c0a-da9b-4ada-8bca-29c9c67cef5b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.151398 Sep 15 08:50:32.598072 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 15/28] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:32 2021] POST /compute/v2.1/flavors => generated 365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:32.613684 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-8bea54e1-7afb-4311-8fb2-b34e2d0feb2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:32.704061 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-8bea54e1-7afb-4311-8fb2-b34e2d0feb2b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.099417 Sep 15 08:50:32.704592 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 14/29] 10.222.0.39 () {62 vars in 1243 bytes} [Wed Sep 15 08:50:32 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:50:32.718937 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-ce734952-fe2c-4774-9167-abd76d3ccee2 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:32.738559 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-ce734952-fe2c-4774-9167-abd76d3ccee2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028369 Sep 15 08:50:32.739069 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 16/30] 10.222.0.39 () {58 vars in 1190 bytes} [Wed Sep 15 08:50:32 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:34.869865 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-0ecb6955-f592-4523-8d1b-1ab106b28510 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:34.964520 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-0ecb6955-f592-4523-8d1b-1ab106b28510 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.171884 Sep 15 08:50:34.965005 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 15/31] 10.222.0.39 () {62 vars in 1193 bytes} [Wed Sep 15 08:50:34 2021] POST /compute/v2.1/flavors => generated 368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:50:34.980768 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-52f9ba83-c021-4930-8d6c-0a7cf9ce7b67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:50:35.071879 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-52f9ba83-c021-4930-8d6c-0a7cf9ce7b67 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.100409 Sep 15 08:50:35.072448 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 17/32] 10.222.0.39 () {62 vars in 1243 bytes} [Wed Sep 15 08:50:34 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:50:35.086651 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-c1033686-98a7-4028-af00-43dbd36d8077 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:50:35.108722 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-c1033686-98a7-4028-af00-43dbd36d8077 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030441 Sep 15 08:50:35.109226 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 16/33] 10.222.0.39 () {58 vars in 1190 bytes} [Wed Sep 15 08:50:35 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:51:43.344710 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-e547ef06-46f1-4825-8611-72cbdd401d10 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:43.366399 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-e547ef06-46f1-4825-8611-72cbdd401d10 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.101426 Sep 15 08:51:43.366934 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 18/34] 10.222.0.39 () {58 vars in 1160 bytes} [Wed Sep 15 08:51:43 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:51:44.767121 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-c1033686-98a7-4028-af00-43dbd36d8077 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:44.768116 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-c1033686-98a7-4028-af00-43dbd36d8077 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Sep 15 08:51:44.768501 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 17/35] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:44.981423 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-47dea7b8-7ca6-4e85-af53-24a84a9c0813 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:44.993515 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.wsgi [None req-47dea7b8-7ca6-4e85-af53-24a84a9c0813 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 08:51:44.994108 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-47dea7b8-7ca6-4e85-af53-24a84a9c0813 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=75146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:51:44.994904 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-47dea7b8-7ca6-4e85-af53-24a84a9c0813 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.090742 Sep 15 08:51:44.995423 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 19/36] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Sep 15 08:51:44 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 08:51:45.009327 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-b04b5198-8762-408c-b314-70473b4faff0 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:45.029992 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-b04b5198-8762-408c-b314-70473b4faff0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028937 Sep 15 08:51:45.030559 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Sep 15 08:51:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:51:45.049389 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-76a4c7fb-5d5e-4fac-aa7b-c1ce1d397ecf admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:45.068526 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-76a4c7fb-5d5e-4fac-aa7b-c1ce1d397ecf admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027512 Sep 15 08:51:45.069037 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 20/38] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Sep 15 08:51:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:51:45.084140 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-97f30f82-5245-4c35-a0bc-963b7e8d3c40 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:45.099900 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.wsgi [None req-97f30f82-5245-4c35-a0bc-963b7e8d3c40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 08:51:45.100471 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-97f30f82-5245-4c35-a0bc-963b7e8d3c40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=75147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:51:45.101260 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-97f30f82-5245-4c35-a0bc-963b7e8d3c40 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.025853 Sep 15 08:51:45.101772 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Sep 15 08:51:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 08:51:46.419809 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-76a4c7fb-5d5e-4fac-aa7b-c1ce1d397ecf admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:46.420805 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-76a4c7fb-5d5e-4fac-aa7b-c1ce1d397ecf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Sep 15 08:51:46.421200 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 21/40] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:46.630516 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-6e366d46-2468-4d4c-bfa8-ec8d98bec35c admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:46.642735 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.wsgi [None req-6e366d46-2468-4d4c-bfa8-ec8d98bec35c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 08:51:46.643292 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-6e366d46-2468-4d4c-bfa8-ec8d98bec35c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=75147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:51:46.644058 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-6e366d46-2468-4d4c-bfa8-ec8d98bec35c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.089698 Sep 15 08:51:46.644548 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Sep 15 08:51:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 08:51:46.658941 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-80b82906-67eb-46c7-9daf-1a0472d28d13 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:46.677945 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-80b82906-67eb-46c7-9daf-1a0472d28d13 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027932 Sep 15 08:51:46.678486 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Sep 15 08:51:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:51:46.692216 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-beedac25-5a7f-40d4-af67-0d850849c86b admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:46.711907 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-beedac25-5a7f-40d4-af67-0d850849c86b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027975 Sep 15 08:51:46.712427 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 21/43] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Sep 15 08:51:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:51:46.726600 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-e5e0420b-e9fa-426e-82eb-229a318328a8 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:46.738552 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.wsgi [None req-e5e0420b-e9fa-426e-82eb-229a318328a8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 08:51:46.739109 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-e5e0420b-e9fa-426e-82eb-229a318328a8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=75146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:51:46.739884 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-e5e0420b-e9fa-426e-82eb-229a318328a8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.021506 Sep 15 08:51:46.740363 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1191 bytes} [Wed Sep 15 08:51:46 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 08:51:48.074953 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-beedac25-5a7f-40d4-af67-0d850849c86b admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:48.075934 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-beedac25-5a7f-40d4-af67-0d850849c86b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001918 Sep 15 08:51:48.076321 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 22/45] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:48.288046 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-eec7a549-870e-4497-a54d-6d83e9a54726 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:48.299929 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.wsgi [None req-eec7a549-870e-4497-a54d-6d83e9a54726 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 08:51:48.300490 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-eec7a549-870e-4497-a54d-6d83e9a54726 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=75146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:51:48.301264 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-eec7a549-870e-4497-a54d-6d83e9a54726 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.090874 Sep 15 08:51:48.301760 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Sep 15 08:51:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 08:51:48.318810 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-612b8857-c007-4ff3-abb5-7eca0c01bdf0 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:48.341065 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-612b8857-c007-4ff3-abb5-7eca0c01bdf0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.033793 Sep 15 08:51:48.341600 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Sep 15 08:51:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:51:48.356199 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:48.375928 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028224 Sep 15 08:51:48.376453 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 25/48] 10.222.0.39 () {60 vars in 1211 bytes} [Wed Sep 15 08:51:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:51:48.390645 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-2860f483-3107-4c00-8ab8-c76737a1b5a7 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:48.402280 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.wsgi [None req-2860f483-3107-4c00-8ab8-c76737a1b5a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 08:51:48.402846 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-2860f483-3107-4c00-8ab8-c76737a1b5a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=75147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:51:48.403611 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-2860f483-3107-4c00-8ab8-c76737a1b5a7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.021863 Sep 15 08:51:48.404091 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Sep 15 08:51:48 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 08:51:49.738285 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:49.739307 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 15 08:51:49.739698 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 26/50] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:49.949511 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-08c0fb0b-a97f-4a05-a215-5e5f8a2538cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:51:50.051991 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-08c0fb0b-a97f-4a05-a215-5e5f8a2538cc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.179032 Sep 15 08:51:50.052547 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 25/51] 10.222.0.39 () {64 vars in 1236 bytes} [Wed Sep 15 08:51:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:51:51.375914 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:51.376903 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Sep 15 08:51:51.377299 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 27/52] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:51.587316 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-235ed579-72bd-4101-915d-78aec48b7f0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:51:51.650685 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-235ed579-72bd-4101-915d-78aec48b7f0c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.140146 Sep 15 08:51:51.651232 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 26/53] 10.222.0.39 () {64 vars in 1236 bytes} [Wed Sep 15 08:51:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:51:52.962392 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:52.963415 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 15 08:51:52.963803 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 28/54] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:53.175365 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-bbdc2f73-1260-4c97-ba82-0a33868e8374 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:51:53.257322 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-bbdc2f73-1260-4c97-ba82-0a33868e8374 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.160151 Sep 15 08:51:53.257852 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 27/55] 10.222.0.39 () {64 vars in 1236 bytes} [Wed Sep 15 08:51:53 2021] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:51:54.584064 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:54.585055 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Sep 15 08:51:54.585448 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:54.796040 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-25087953-ff9d-495a-8095-a0cf86a3e9ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:51:54.863057 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-25087953-ff9d-495a-8095-a0cf86a3e9ab admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.143681 Sep 15 08:51:54.863580 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 28/57] 10.222.0.39 () {64 vars in 1236 bytes} [Wed Sep 15 08:51:54 2021] POST /compute/v2.1/flavors => generated 409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:51:56.193948 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:56.194971 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 15 08:51:56.195362 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 30/58] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:51:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:51:56.406681 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-dc477dc1-fe91-4b26-aef4-7fc9ea95e707 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:51:56.437181 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-dc477dc1-fe91-4b26-aef4-7fc9ea95e707 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.108113 Sep 15 08:51:56.437708 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 29/59] 10.222.0.39 () {60 vars in 1203 bytes} [Wed Sep 15 08:51:56 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:52:33.931062 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:52:33.932091 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-8ef41148-2de8-4111-b499-adf880620290 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 15 08:52:33.932508 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:52:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:52:34.146938 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:52:34.178866 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.110117 Sep 15 08:52:34.179393 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1203 bytes} [Wed Sep 15 08:52:34 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:53:56.438424 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-5dbce59d-3432-4e59-aca9-e65f77d4c598 tempest-verify_tempest_config-1763549148 tempest-verify_tempest_config-1763549148-project] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:53:56.444951 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-5dbce59d-3432-4e59-aca9-e65f77d4c598 tempest-verify_tempest_config-1763549148 tempest-verify_tempest_config-1763549148-project] 10.222.0.39 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.143952 Sep 15 08:53:56.445472 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 32/62] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Sep 15 08:53:56 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:55:27.448941 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:27.449928 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Sep 15 08:55:27.450345 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 31/63] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:55:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:55:27.728422 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-281a4ffb-3abc-4f66-b20e-9e23679ea3e6 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:27.734650 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:55:27.734650 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: warnings.warn(msg) Sep 15 08:55:27.736115 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-281a4ffb-3abc-4f66-b20e-9e23679ea3e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:27.736550 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-281a4ffb-3abc-4f66-b20e-9e23679ea3e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:27.737326 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-281a4ffb-3abc-4f66-b20e-9e23679ea3e6 admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:27.738012 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-281a4ffb-3abc-4f66-b20e-9e23679ea3e6 admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:27.767389 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-281a4ffb-3abc-4f66-b20e-9e23679ea3e6 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.182015 Sep 15 08:55:27.767923 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Sep 15 08:55:27 2021] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:55:29.099657 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:29.100657 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 15 08:55:29.101073 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 32/65] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:55:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:55:29.315812 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-0e4b0758-a2c4-4e40-a141-857f4b295e6b admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:29.321658 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:55:29.321658 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: warnings.warn(msg) Sep 15 08:55:29.323132 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0e4b0758-a2c4-4e40-a141-857f4b295e6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:29.323578 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0e4b0758-a2c4-4e40-a141-857f4b295e6b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:29.324368 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0e4b0758-a2c4-4e40-a141-857f4b295e6b admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:29.324793 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-0e4b0758-a2c4-4e40-a141-857f4b295e6b admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:29.348260 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-0e4b0758-a2c4-4e40-a141-857f4b295e6b admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.110607 Sep 15 08:55:29.348812 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Sep 15 08:55:29 2021] GET /compute/v2.1/os-services => generated 791 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:55:41.107512 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:41.108483 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001381 Sep 15 08:55:41.108858 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 33/67] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:55:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:55:41.320680 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-12d2677b-2d49-4860-aa90-14d044bd954c admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:41.326451 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:55:41.326451 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: warnings.warn(msg) Sep 15 08:55:41.328476 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-12d2677b-2d49-4860-aa90-14d044bd954c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:41.328909 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-12d2677b-2d49-4860-aa90-14d044bd954c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:41.329677 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-12d2677b-2d49-4860-aa90-14d044bd954c admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:41.330115 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-12d2677b-2d49-4860-aa90-14d044bd954c admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:41.357163 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-12d2677b-2d49-4860-aa90-14d044bd954c admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.113755 Sep 15 08:55:41.357690 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Sep 15 08:55:41 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:55:42.711181 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: DEBUG nova.api.openstack.wsgi [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] Calling method '>' {{(pid=75147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:42.712154 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: INFO nova.api.openstack.requestlog [None req-1ae37129-e3c2-4270-927f-9bef523b2c23 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001383 Sep 15 08:55:42.712541 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: [pid: 75147|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1075 bytes} [Wed Sep 15 08:55:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:55:42.924308 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG nova.api.openstack.wsgi [None req-42c7b9d5-09c2-4253-b6fa-649141317994 admin admin] Calling method '>' {{(pid=75146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:55:42.930008 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:55:42.930008 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: warnings.warn(msg) Sep 15 08:55:42.931466 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-42c7b9d5-09c2-4253-b6fa-649141317994 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:42.931896 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-42c7b9d5-09c2-4253-b6fa-649141317994 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:42.932669 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-42c7b9d5-09c2-4253-b6fa-649141317994 admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:55:42.933083 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: DEBUG oslo_concurrency.lockutils [None req-42c7b9d5-09c2-4253-b6fa-649141317994 admin admin] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=75146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:55:42.959706 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: INFO nova.api.openstack.requestlog [None req-42c7b9d5-09c2-4253-b6fa-649141317994 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.113114 Sep 15 08:55:42.960236 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: [pid: 75146|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1194 bytes} [Wed Sep 15 08:55:42 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:56:37.958974 dv-cinder-806008-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 08:56:37.959477 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: Wed Sep 15 08:56:37 2021 - graceful shutdown triggered... Sep 15 08:56:37.959906 dv-cinder-806008-2-iscsi devstack@n-api.service[75147]: Gracefully killing worker 2 (pid: 75147)... Sep 15 08:56:37.960259 dv-cinder-806008-2-iscsi devstack@n-api.service[75146]: Gracefully killing worker 1 (pid: 75146)... Sep 15 08:56:38.960590 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: worker 1 buried after 1 seconds Sep 15 08:56:38.960969 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: worker 2 buried after 1 seconds Sep 15 08:56:38.960969 dv-cinder-806008-2-iscsi devstack@n-api.service[75145]: goodbye to uWSGI. Sep 15 08:56:38.962146 dv-cinder-806008-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 08:56:38.962692 dv-cinder-806008-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 08:56:38.965478 dv-cinder-806008-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 08:56:38.977825 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 15 08:56:38 2021] *** Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: nodename: dv-cinder-806008-2-iscsi Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: machine: x86_64 Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: clock source: unix Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: pcre jit disabled Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: detected number of CPU cores: 4 Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: current working directory: / Sep 15 08:56:38.979432 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: detected binary path: /usr/bin/uwsgi-core Sep 15 08:56:38.980109 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: your processes number limit is 47680 Sep 15 08:56:38.980109 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: your memory page size is 4096 bytes Sep 15 08:56:38.980109 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: detected max file descriptor number: 2048 Sep 15 08:56:38.980109 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: lock engine: pthread robust mutexes Sep 15 08:56:38.980109 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: thunder lock: enabled Sep 15 08:56:38.980109 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 08:56:38.980109 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 15 08:56:39.024611 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: Python main interpreter initialized at 0x55a4888609c0 Sep 15 08:56:39.024611 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: python threads support enabled Sep 15 08:56:39.024611 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: your server socket listen backlog is limited to 100 connections Sep 15 08:56:39.024611 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: your mercy for graceful operations on workers is 90 seconds Sep 15 08:56:39.025060 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 08:56:39.025060 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: *** Operational MODE: preforking *** Sep 15 08:56:39.025323 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: *** uWSGI is running in multiple interpreter mode *** Sep 15 08:56:39.025323 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: spawned uWSGI master process (pid: 89563) Sep 15 08:56:39.025528 dv-cinder-806008-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 08:56:39.026748 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: spawned uWSGI worker 1 (pid: 89582, cores: 1) Sep 15 08:56:39.026748 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: spawned uWSGI worker 2 (pid: 89583, cores: 1) Sep 15 08:56:39.026748 dv-cinder-806008-2-iscsi devstack@n-api.service[89563]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 08:56:43.044566 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 08:56:43.045220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 08:56:43.045326 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 08:56:43.046190 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 08:56:43.046452 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 08:56:43.046844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.047168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.047491 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.047822 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.048141 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.048456 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.048783 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.049094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.049413 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.049739 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.050064 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.050351 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.050668 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.050992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806008-2-iscsi {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.051312 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.051844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.052159 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.052478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.052787 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.053114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.053435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.053919 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.055390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.055390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.055390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.055390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.055733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.055972 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.056217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.056539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.056855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.057184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.057492 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806008-2-iscsi {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.057808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.058134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.058452 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.058866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.059182 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.059497 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.059831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.060152 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.060462 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.060793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.061660 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.061988 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.062344 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.062716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.062959 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.063276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.063598 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.063911 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.064221 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.064475 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.064785 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.065109 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.065432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.065795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.066182 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.066447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.066797 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.067148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.067467 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.067781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.068137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.068542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.068856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.069226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.069539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.069855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.070203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.070528 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.070857 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.071169 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.071510 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.071913 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.072169 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.072478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.072820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.073141 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.073451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.073775 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.074113 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.074428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.074739 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.075054 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.075375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.075697 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.076002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.076257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.076561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.076894 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.077216 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.077322 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 08:56:43.077771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.077848 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 08:56:43.077936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.078028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 08:56:43.078225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.078394 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 08:56:43.078506 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.078654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 08:56:43.078755 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.079018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.079118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.079329 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.079434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.079640 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.079737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.079947 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.080049 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.080254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.080347 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.080556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.080707 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.080913 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.081040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.081162 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.081366 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.081485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.081690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.081807 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.082012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.082138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.082371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.082462 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.082635 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.082719 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.082951 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.083033 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.083277 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806008-2-iscsi {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.083368 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.083600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.083690 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.083909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.084001 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.084222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.084317 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.084521 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.085714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.085714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.085889 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.085889 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.086062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.086062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087222 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087222 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087685 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.087925 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088104 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088190 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088274 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088366 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088460 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088643 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.088918 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089412 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089546 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089677 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806008-2-iscsi {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.089958 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.090202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.090315 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.090514 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.090613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.090824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.090922 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.091131 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.091235 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.091455 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.091559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.091798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.091904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.092132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.092254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.092473 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.092575 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.092807 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.092912 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.093129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.093226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.093450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.093555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.093772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.093885 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.094075 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.094190 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.094411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.094521 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.094722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.094830 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.095045 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.095145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.095354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.095461 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.095662 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.095767 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.095909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.096013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.096216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.096320 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.096541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.096702 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.096857 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.097000 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.097173 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.097328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.097480 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.097632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.097784 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.097955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.098184 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.098355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.098527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.098681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.098864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.099026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.099203 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.099358 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.099503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.099645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.099795 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.099952 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.100491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.100645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.100798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.100951 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.101105 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.101255 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.101408 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.101558 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.101701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.101844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.101987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.102215 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.102373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.102519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.102669 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.102813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.102963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.103130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.103274 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.103424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.103574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.103717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.103869 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.104035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.104187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.104331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.104474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.104623 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.104774 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.104927 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.105089 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.105327 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.105482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.105632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.105790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.105947 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.106188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.106341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.106484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.106626 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.106780 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.106924 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.107066 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.107226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.107377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.107377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.107665 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.107809 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.108465 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.108617 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.108761 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.108903 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.109055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.110654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.111144 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.111292 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.112198 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.112373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.112531 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.112685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.112830 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.112981 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.113133 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119708 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.119876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.121656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.123019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.123019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.123297 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.123550 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.124214 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.124472 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.124472 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.124759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.124902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.124902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.125182 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.125333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.125501 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.125645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.125789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.125931 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.126074 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.126315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.126468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.126619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.126763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.126906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.126906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.127194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.127350 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.127510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.127703 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.127848 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.127848 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.128126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.128282 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.128431 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.128574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.128890 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.129148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.129307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.129307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.129592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.129754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.129907 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.130058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.130226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.130382 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.130382 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.131158 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.131311 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.131464 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.131614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.131757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.131914 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.132072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.132259 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.132420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.132571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.132571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.132850 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.133005 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.133148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.133290 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.133471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.133471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.133896 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.133896 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.134310 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.134473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.134625 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.134625 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.134903 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.134903 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.135193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.135337 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.135337 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.135615 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.135843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.135843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.136122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.136279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.136279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.136565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.136723 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.136867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.137023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.137166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.137309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.137465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.137617 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.137761 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.137902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.138045 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.138251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.138251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.138597 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 08:56:43.138750 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.138893 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.139042 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.139309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.139474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.139474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.139994 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.140203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.140203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.140478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.140855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.140855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.140855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.141566 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.141716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.141870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.142021 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.142187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.142349 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.142349 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.142633 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.142789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.142939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.143105 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.143250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.143392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.143541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.143694 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.143837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.143989 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.144139 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.144283 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.144425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.144576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.144719 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.144878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.145022 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.145172 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.145324 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.145476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.145619 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.145761 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.145761 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.146052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.146238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.146382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.146538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.146681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.146833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.146983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.147140 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.147140 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.147417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.147572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.147723 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.147866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.148022 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.148173 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.148323 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.148475 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.148618 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.148787 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.148931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.149081 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.149233 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.149463 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.149612 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.149769 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.149920 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.150064 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.150231 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.150374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.150374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.150675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.150675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.151174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.151496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.151769 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.151769 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.152064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.152209 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.152361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.152504 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.152645 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.152787 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.152938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.153089 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.153250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.153401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.153551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.153708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.153858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.154001 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.154216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.154375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.154527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.154680 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.154851 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.154994 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.155144 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.155305 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.155450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.155450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.155735 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.155879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.156035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.156182 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.156324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.156476 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.156619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.156768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.156918 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.157125 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.157284 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.157436 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.157580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.157729 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.157879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158656 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.158947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.159234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.159234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.159609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.159760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.160073 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.160213 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.160603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.160756 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.160919 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.161206 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.161299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.161395 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.161638 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.161757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.161891 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.161989 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162133 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162223 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162446 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162543 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162810 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162891 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.162986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163160 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163415 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163498 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163580 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163904 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.163999 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164084 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164165 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164246 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164336 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164419 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164677 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164766 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.164938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165034 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165255 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165346 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165530 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165623 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165871 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.165952 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166533 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166626 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166626 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.166866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.167988 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168121 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168290 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168373 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.168977 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.169113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.169300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.169667 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.169755 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.169837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.169927 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.170009 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.170289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.170964 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.171147 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.171311 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.171548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.172028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.172139 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.172253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.172337 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.172545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.172652 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.172917 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.173028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.173236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.173329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.173557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.173654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.173876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.173980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.174223 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.174319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.174544 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.174635 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.174861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.174962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.175176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.175267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.175490 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.175589 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.175805 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.175905 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.176138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.176229 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.176456 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.176555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.176768 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.176867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.177080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.177171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.177392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.177490 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.177718 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.177808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.178041 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.178157 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.178402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.178497 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.178722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.178821 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.179035 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.179125 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.179349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.179447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.179667 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.179803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.179984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.180078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.180297 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.180386 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.180614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.180707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.180933 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.181026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.181248 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.181340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.181561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.181663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.181889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.182000 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.182224 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.182385 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.182540 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.182633 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.182869 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.182960 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.183187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.183286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.183514 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.183606 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.183826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.183924 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.184139 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.184237 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.184450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.184548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.184767 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.184863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.185077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.185175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.185387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.185483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.185696 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.185794 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.186066 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.186685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.186898 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.186997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.187220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.187311 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.187539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.187631 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.187856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.187995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.188173 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.188266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.188489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.188584 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.188802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.188894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.189115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.189205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.189431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.189523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.189742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.189832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.190060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.190217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.190386 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.190472 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.190699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.190790 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.191015 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.191113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.191328 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.191457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.191642 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.191777 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.191972 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.192100 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194260 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194452 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194653 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.194848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195007 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195092 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195278 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195278 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195278 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195278 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195568 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.195835 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.196125 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.196229 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.196468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.196567 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.196780 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.196888 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.197087 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.197212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.197472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.197676 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.197791 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.198010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.198265 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.198381 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.198613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.198734 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.199082 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.199217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.199404 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.199707 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.199814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.200034 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.200148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.200435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.200611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.200762 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.201091 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.201198 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.201418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.201515 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.201763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.201868 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.202076 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.202357 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.202468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.202726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.202904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.203031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.203361 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.203479 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.203693 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.203792 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.204012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.204111 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.204333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.204446 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.204641 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.204745 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.204974 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.205074 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.205304 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.205410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.205659 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.205767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.205999 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.206155 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.206312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.206430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.206709 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.206897 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.207083 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.207215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.207346 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.207667 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.207846 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.208026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.208121 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.208301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.208475 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.208717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.208820 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.208906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.209129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.209295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.209448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.209609 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.209786 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.209962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.210160 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.210396 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.210723 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.210883 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.211040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.211205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.211205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.211499 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.211671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.211985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.212155 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.212321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.212581 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.212912 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.213093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.213327 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.213496 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.213659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.213813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.213979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.213979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.214398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.214575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.214729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.214883 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.215035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.215198 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.215360 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.215530 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.215776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.215945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.216099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.216254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.216407 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.216407 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.216790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.216790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.217081 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.217267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.217428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.217592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.217745 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.217900 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.218053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.218256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.218433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.218604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.218776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.219008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.219176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.219339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.219505 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.219661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.219822 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.219985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.220148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.220303 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.220551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.220714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.220879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.221032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.221185 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.221338 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.221503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.221666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.221828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.222149 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.222314 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.222573 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.222803 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.223212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.223458 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.223633 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.223797 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.223962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.224117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.224278 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.224439 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.224593 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.224757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.224925 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.225089 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.225251 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.225405 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.225559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.225724 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.225982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.226260 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.226422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.226582 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.226737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.226890 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.227053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.227215 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.227378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.227548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.227735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.227907 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.228076 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.228229 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.228391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.228555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.228709 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.228872 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.229046 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.229268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.229427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.229594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.229758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.229923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.230078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.230268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.230434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.230690 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.230866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.231031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.231185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.231338 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.231492 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.231645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.231806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.231970 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.232264 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.232435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.232598 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.232760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.233748 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.233920 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.234077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.234298 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.234453 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.234453 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.234782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.235030 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.235192 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.235354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.235520 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.235682 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.235844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.236093 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.236255 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.236421 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.236582 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.236745 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.236908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.237069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.237231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.237394 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.237557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.237557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.237870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.238031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.238223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.238380 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.238541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.238710 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.238871 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.238871 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.239523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.239683 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.239844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.240019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.240173 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.240341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.240510 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.240693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.240925 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.241092 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.241254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.241418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.241572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.241735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.241889 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.242064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.242402 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.242402 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.242729 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.242885 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.243046 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.243200 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.243436 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.243828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.244019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.244258 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.244418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.244572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.244738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.244898 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.245062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.245215 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.245376 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.245538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.245694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.245860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.246014 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.246341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.246548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.246743 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.246935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.247156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.247356 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.247554 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.247746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.247944 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.248134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.248408 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.249125 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.249288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.249443 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.249681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.249851 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.249851 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.250207 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.250448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.250605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.250759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.251124 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.251296 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.251452 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.251613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.251768 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.251931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.252099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.252255 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.252561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.252561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.252875 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.253040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.253208 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.253362 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.253515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.253830 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.254142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.254403 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.254582 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.254737 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.254890 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.255055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.255209 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.255361 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.255529 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.255691 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.255845 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.256005 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.256161 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.256342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.256568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.256568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.256872 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.257029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.257201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.257371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.257534 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.257689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.257850 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.258013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.258204 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.258374 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.258537 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.258691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.258844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.259004 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.259186 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.259186 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.259502 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.259674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.259884 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.260052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.260216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.260380 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.260541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.260704 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.260866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.261029 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.261344 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.261524 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.261680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.261833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.261987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.262185 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.262355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.262652 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.262814 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.262976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.263138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.263292 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.263458 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.263612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.263928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.264129 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.264368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.264643 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.264811 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.264966 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.265126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.265280 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.265442 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.265606 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.265813 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.265977 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.266161 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.266334 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.266496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.266746 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.266907 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.267061 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.267213 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.267374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.267528 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.267696 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.267858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.268021 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.268183 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.268336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.268336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.268707 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.268862 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269023 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269023 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269505 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269667 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269822 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.269976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.270312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.270476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.270640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.270802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.270964 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.271119 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.271452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.271633 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.271790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.271953 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.272116 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.272277 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.272431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.272431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.272931 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.273094 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.273256 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.273411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.273612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.273770 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.274272 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.274535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.274826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.274999 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.275164 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.275320 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.275473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.275637 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.275798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.275961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.276133 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.276294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.276448 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.276608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.276789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.277016 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.277185 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.277340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.277492 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.277654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.277826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.277982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.278251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.278442 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.278597 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.278750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.278911 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.279086 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.279256 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.279411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.279572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.280246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.280246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.280574 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.280574 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.280876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.280876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.281176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.281176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.281632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.281798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.281961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.282172 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.282346 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.282561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.282967 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.283131 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.283286 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.283450 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.283605 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.283774 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.283937 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.284104 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.284465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.284728 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.284998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.285176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.285403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.285403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.285716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.285879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.286034 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.286228 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.286228 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.286533 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.286689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.286850 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.287025 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.287277 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.287445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.287610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.287610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.287931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.288142 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.288298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.288451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.288614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.288770 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.288932 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.289131 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.289291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.289467 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.289646 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.289814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.289982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.290250 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.290413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.290580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.290737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.290891 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.291054 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.291209 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.291370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.291688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.291868 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.292024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.292201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.292363 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.292518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.292673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.292847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.293161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.293328 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.293484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.293638 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.293800 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.293958 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.294144 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.294317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.294657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.294935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.295233 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.295952 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.296134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.296339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.296503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.296660 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.296824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.296992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.297161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.297423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.297593 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.297749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.297912 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.298078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.298260 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.298435 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.298599 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.298762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.298925 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.299091 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.299254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.299410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.299577 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.299750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.299907 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.300074 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.300238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.300401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.300557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.300557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.300868 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.301031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.301188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.301351 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.301516 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.301837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.302027 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.302229 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.302389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.302543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.302698 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.302853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.303183 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.303349 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.303504 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.303666 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.303831 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.304007 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.304171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.304335 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.304497 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.304864 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305403 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=89583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.305574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.306855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.308122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.309402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.311428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.313604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.318894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.320461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.321793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.323263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.324738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.325989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.327876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.329053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.329053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.329053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.329053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.329053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.329053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.329053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.330341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.331603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.331603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.331603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.331603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.331603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.331603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.332743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.332743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.332743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.333186 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.333186 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.333498 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.333853 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.334013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.334318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.334641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.334974 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.335360 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.335630 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.335961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.336311 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.336627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.336991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.337347 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 08:56:43.337622 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=89582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 08:56:43.372628 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_db.sqlalchemy.engines [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.574660 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.context [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e240028-fead-427e-81eb-96ea8b8203bc(cell1) {{(pid=89583) load_cells /opt/stack/nova/nova/context.py:465}} Sep 15 08:56:43.578982 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:56:43.580620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:56:43.581437 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:56:43.583443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:56:43.607860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.609293 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.620613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.context [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e240028-fead-427e-81eb-96ea8b8203bc(cell1) {{(pid=89582) load_cells /opt/stack/nova/nova/context.py:465}} Sep 15 08:56:43.624934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:56:43.626608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:56:43.627434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:56:43.629442 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:56:43.638846 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_db.sqlalchemy.engines [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.654399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_db.sqlalchemy.engines [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.656068 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_db.sqlalchemy.engines [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.684666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_db.sqlalchemy.engines [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 15 08:56:43.878670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO keyring.backend [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Loading KWallet Sep 15 08:56:43.888023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO keyring.backend [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Loading SecretService Sep 15 08:56:43.892751 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO keyring.backend [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Loading Windows Sep 15 08:56:43.894653 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO keyring.backend [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Loading chainer Sep 15 08:56:43.895438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO keyring.backend [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Loading macOS Sep 15 08:56:43.923492 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO keyring.backend [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Loading KWallet Sep 15 08:56:43.932810 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO keyring.backend [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Loading SecretService Sep 15 08:56:43.936969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO keyring.backend [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Loading Windows Sep 15 08:56:43.938678 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO keyring.backend [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Loading chainer Sep 15 08:56:43.939465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO keyring.backend [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Loading macOS Sep 15 08:56:44.151633 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: WARNING keystonemiddleware.auth_token [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:56:44.158182 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: WARNING keystonemiddleware.auth_token [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:56:44.192302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: WARNING keystonemiddleware.auth_token [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:56:44.198945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: WARNING keystonemiddleware.auth_token [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:56:44.372813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: WARNING keystonemiddleware.auth_token [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:56:44.378547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: WARNING keystonemiddleware.auth_token [None req-ff9fa624-4889-4f7b-a828-249b589f66b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:56:44.383748 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a4888609c0 pid: 89583 (default app) Sep 15 08:56:44.413799 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: WARNING keystonemiddleware.auth_token [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 08:56:44.418948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: WARNING keystonemiddleware.auth_token [None req-66af7b0d-4955-4945-8006-d222e489f0b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 08:56:44.424746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a4888609c0 pid: 89582 (default app) Sep 15 08:57:41.109657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dd19e42d-9d34-43a1-9e42-5dab9297bc35 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Action: 'create', calling method: .version_select at 0x7f1ec6bf21f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1259407340", "metadata": {"Type": "work"}}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:57:42.271548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dd19e42d-9d34-43a1-9e42-5dab9297bc35 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.796404 Sep 15 08:57:42.272493 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Sep 15 08:57:40 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1799 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 08:57:42.647126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e0547fa5-2b20-4ec7-bc86-e37dfcc0ab62 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Calling method '.version_select at 0x7f1ec75823a0>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:43.071725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e0547fa5-2b20-4ec7-bc86-e37dfcc0ab62 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0" status: 200 len: 353 microversion: 2.1 time: 0.788062 Sep 15 08:57:43.072603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:57:42 2021] GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 => generated 353 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:57:44.092485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d51249ff-334b-486c-a6b8-825df33effd8 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Calling method '.version_select at 0x7f1ec6a598b0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:44.257064 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d51249ff-334b-486c-a6b8-825df33effd8 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0" status: 200 len: 354 microversion: 2.1 time: 0.175536 Sep 15 08:57:44.258075 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:57:44 2021] GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 => generated 354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:57:44.277786 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-899ad8b5-fb7b-4963-a930-18df6a6c28c8 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Calling method '.version_select at 0x7f1ec6a1d8b0>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:44.400256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-899ad8b5-fb7b-4963-a930-18df6a6c28c8 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0" status: 200 len: 354 microversion: 2.1 time: 0.134032 Sep 15 08:57:44.401997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:57:44 2021] GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:57:44.424642 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-26eb2754-f49e-4387-b9ee-c4a80ac5b236 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Calling method '.version_select at 0x7f1ec6a59f70>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:44.878869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-26eb2754-f49e-4387-b9ee-c4a80ac5b236 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0" status: 202 len: 0 microversion: 2.1 time: 0.467109 Sep 15 08:57:44.885077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Sep 15 08:57:44 2021] DELETE /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:57:44.898320 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-32cd4df8-dea8-4d68-83db-8b82ee4ec944 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Calling method '.version_select at 0x7f1ec69ed430>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:45.093879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-32cd4df8-dea8-4d68-83db-8b82ee4ec944 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0" status: 200 len: 353 microversion: 2.1 time: 0.209310 Sep 15 08:57:45.095108 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:57:44 2021] GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:57:45.321413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-162295751", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "1c409703-0674-4cbb-9f3e-f398f357604d"}]}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:57:45.710055 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.network.neutron [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] validate_networks() for [('1c409703-0674-4cbb-9f3e-f398f357604d', None, None, None)] {{(pid=89582) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:57:46.426165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1006712842", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "5a040df8-ed58-4b30-86be-d147eeae93bb"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:57:46.590026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] validate_networks() for [('5a040df8-ed58-4b30-86be-d147eeae93bb', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:57:48.350211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:57:48.351774 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:57:48.353053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:57:48.354002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:57:48.354709 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:57:48.372874 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:48.376299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:48.391400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:48.392229 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:48.451613 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Getting quotas for project 79788e6decc74ae4b1d9bd92aa35a8ab. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:57:48.468263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Getting quotas for user 24fa2d6a67774d9bbd7b80786bb0d74b and project 79788e6decc74ae4b1d9bd92aa35a8ab. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:57:48.468489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:57:48.473156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:57:48.473156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:57:48.473156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:57:48.473156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:57:48.488661 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:57:48.490302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:48.497139 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:48.501850 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:48.501850 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:48.509189 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:57:48.556223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:57:48.571321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for user aa9a7f77c7354c099697032b66c9a99a and project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:57:48.592246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Going to run 1 instances... {{(pid=89582) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:57:48.596341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:57:48.761648 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-91944829-c6cc-438b-9e81-2493d93a5626 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.765763 Sep 15 08:57:48.771880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 5/7] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:57:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 08:57:48.809960 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e1568c7a-5041-410f-9e01-93e7eaf51a25 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Calling method '.version_select at 0x7f1ec6929670>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:48.832256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4d2deb7f-25b1-4c40-a75a-edf1212ee1ca tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.010712 Sep 15 08:57:48.834737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 3/8] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:57:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 4014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 08:57:48.863749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-08381f5b-0661-4f50-b566-c508177baf13 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:48.866789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-08381f5b-0661-4f50-b566-c508177baf13 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:49.017527 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-e1568c7a-5041-410f-9e01-93e7eaf51a25 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] HTTP exception thrown: Volume 5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 could not be found. Sep 15 08:57:49.031627 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e1568c7a-5041-410f-9e01-93e7eaf51a25 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] Returning 404 to user: Volume 5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:57:49.031627 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e1568c7a-5041-410f-9e01-93e7eaf51a25 tempest-VolumesGetTestJSON-1520744068 tempest-VolumesGetTestJSON-1520744068-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0" status: 404 len: 109 microversion: 2.1 time: 0.245818 Sep 15 08:57:49.031627 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 6/9] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:57:48 2021] GET /compute/v2.1/os-volumes/5a3ee603-07f2-4e26-ac88-bbc3c0d274e0 => generated 109 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 08:57:49.044489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4ed18fbc-6a3f-4c4f-a00a-e887cb7d876d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:49.045141 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4ed18fbc-6a3f-4c4f-a00a-e887cb7d876d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:49.128699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-08381f5b-0661-4f50-b566-c508177baf13 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:49.158012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-08381f5b-0661-4f50-b566-c508177baf13 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1215 microversion: 2.1 time: 0.317525 Sep 15 08:57:49.169586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 4/10] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:48 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1215 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:49.446718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4ed18fbc-6a3f-4c4f-a00a-e887cb7d876d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:49.477322 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4ed18fbc-6a3f-4c4f-a00a-e887cb7d876d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1217 microversion: 2.1 time: 0.454950 Sep 15 08:57:49.479477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 7/11] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:49 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1217 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:50.182844 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-aeccc7e0-e4ea-4722-9f97-39ae3a37fab7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:50.193425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-aeccc7e0-e4ea-4722-9f97-39ae3a37fab7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:50.503742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0e6406ce-bdb2-4a60-8603-b8332bbc5939 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:50.504360 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0e6406ce-bdb2-4a60-8603-b8332bbc5939 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:50.631627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-aeccc7e0-e4ea-4722-9f97-39ae3a37fab7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:50.657081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-aeccc7e0-e4ea-4722-9f97-39ae3a37fab7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1215 microversion: 2.1 time: 0.483596 Sep 15 08:57:50.661663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 5/12] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:50 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1215 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:50.800010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0e6406ce-bdb2-4a60-8603-b8332bbc5939 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:50.836808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0e6406ce-bdb2-4a60-8603-b8332bbc5939 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1217 microversion: 2.1 time: 0.344323 Sep 15 08:57:50.839553 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 8/13] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:50 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1217 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:51.687104 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-868af19a-2320-46c9-99c7-13452178cb41 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:51.688378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-868af19a-2320-46c9-99c7-13452178cb41 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:51.863584 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-38413e77-9dd8-4ff8-b865-f082b293949e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:51.864071 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-38413e77-9dd8-4ff8-b865-f082b293949e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:52.076349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-868af19a-2320-46c9-99c7-13452178cb41 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:52.104570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-868af19a-2320-46c9-99c7-13452178cb41 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1215 microversion: 2.1 time: 0.427228 Sep 15 08:57:52.107163 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 6/14] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:51 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:52.222420 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-38413e77-9dd8-4ff8-b865-f082b293949e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:52.245864 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-38413e77-9dd8-4ff8-b865-f082b293949e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1217 microversion: 2.1 time: 0.391874 Sep 15 08:57:52.248360 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 9/15] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:51 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1217 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:53.149266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:53.150705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:53.184319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:53.186800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:53.189046 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:53.190768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:53.270400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:53.271017 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:53.295977 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:53.297392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:53.300281 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:53.306586 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:53.650513 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:53.675102 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-01559d2d-9bf0-41ff-8491-f464bf24dcc6 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1211 microversion: 2.1 time: 0.554205 Sep 15 08:57:53.678452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 7/16] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:53 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1211 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:57:53.761268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:53.793029 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6b9e2010-98e6-4636-a9c5-fdd79133d4b5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1269 microversion: 2.1 time: 0.533093 Sep 15 08:57:53.806502 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 10/17] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:53 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1269 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:54.742215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:54.745672 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:54.781375 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:54.782962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:54.788371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:54.789309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:54.817906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:54.820547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:54.839700 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:54.841037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:54.841969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:54.843011 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:55.250482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:55.269308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-77ea0b7f-68ab-4e57-ace2-90dda7069b42 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1275 microversion: 2.1 time: 0.572428 Sep 15 08:57:55.273368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 8/18] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:54 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1275 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:55.461637 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:55.476201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bf39fc4d-dbdd-4db0-8882-3cbe946492b8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1275 microversion: 2.1 time: 0.669368 Sep 15 08:57:55.477366 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 11/19] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:54 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1275 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:55.891545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2b04b4e0-99a1-4a08-ab73-dbe25d45f032 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Action: 'create', calling method: .version_select at 0x7f1ec68d2550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-34385379", "metadata": {"Type": "work"}}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:57:55.895543 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2b04b4e0-99a1-4a08-ab73-dbe25d45f032 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:57:55.899997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2b04b4e0-99a1-4a08-ab73-dbe25d45f032 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.363098 Sep 15 08:57:55.901923 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 9/20] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Sep 15 08:57:55 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 15 08:57:55.922585 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2a1225f3-cf6c-4cdd-a408-cc4248dea54d tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Action: 'create', calling method: .version_select at 0x7f1ec6875160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-114730851", "metadata": {"Type": "work"}}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:57:55.928134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2a1225f3-cf6c-4cdd-a408-cc4248dea54d tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:57:55.929169 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2a1225f3-cf6c-4cdd-a408-cc4248dea54d tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021626 Sep 15 08:57:55.932060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 12/21] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Sep 15 08:57:55 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 08:57:55.964229 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-494fd2b4-cbc9-48d4-89b8-c513fdbc13d1 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Action: 'create', calling method: .version_select at 0x7f1ec6868ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1441139860", "metadata": {"Type": "work"}}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:57:55.968124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-494fd2b4-cbc9-48d4-89b8-c513fdbc13d1 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:57:55.970246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-494fd2b4-cbc9-48d4-89b8-c513fdbc13d1 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031945 Sep 15 08:57:55.972020 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 10/22] 10.222.0.39 () {60 vars in 1156 bytes} [Wed Sep 15 08:57:55 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 15 08:57:55.998251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1c8e5bb3-f3f0-4c83-b02e-ab82361b7edf tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Calling method '.version_select at 0x7f1ec687b160>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:56.235514 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-1c8e5bb3-f3f0-4c83-b02e-ab82361b7edf tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] HTTP exception thrown: Volume tempest-invalid-829063132 could not be found. Sep 15 08:57:56.235514 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1c8e5bb3-f3f0-4c83-b02e-ab82361b7edf tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Returning 404 to user: Volume tempest-invalid-829063132 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:57:56.235514 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1c8e5bb3-f3f0-4c83-b02e-ab82361b7edf tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-829063132" status: 404 len: 98 microversion: 2.1 time: 0.241657 Sep 15 08:57:56.235514 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 13/23] 10.222.0.39 () {58 vars in 1215 bytes} [Wed Sep 15 08:57:55 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-829063132 => generated 98 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 15 08:57:56.307666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-65abd134-f49c-40ca-9b44-ae82474512d2 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.048073 Sep 15 08:57:56.308531 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 11/24] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Sep 15 08:57:56 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 08:57:56.327596 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:56.328214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:56.338331 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2fb5a529-d6be-4943-bc31-d669bcef5916 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022997 Sep 15 08:57:56.343212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 12/25] 10.222.0.39 () {58 vars in 1137 bytes} [Wed Sep 15 08:57:56 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 08:57:56.363707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:56.375708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:56.378303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:56.380746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4b368839-491f-4cee-b569-33319b6b3a9f tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Calling method '.version_select at 0x7f1ec68d29d0>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:56.381451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:56.586269 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-4b368839-491f-4cee-b569-33319b6b3a9f tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] HTTP exception thrown: Volume 8f8be9f9-b8b0-4d29-a53d-4ef27efe4529 could not be found. Sep 15 08:57:56.587680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4b368839-491f-4cee-b569-33319b6b3a9f tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Returning 404 to user: Volume 8f8be9f9-b8b0-4d29-a53d-4ef27efe4529 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:57:56.588843 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4b368839-491f-4cee-b569-33319b6b3a9f tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/8f8be9f9-b8b0-4d29-a53d-4ef27efe4529" status: 404 len: 109 microversion: 2.1 time: 0.240551 Sep 15 08:57:56.590908 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Sep 15 08:57:56 2021] DELETE /compute/v2.1/os-volumes/8f8be9f9-b8b0-4d29-a53d-4ef27efe4529 => generated 109 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 08:57:56.611896 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:56.612731 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:56.633390 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:56.637929 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:56.639355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:56.640037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:57.005845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:57.030389 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7208c802-5b23-4b31-b125-24bd248047f7 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1273 microversion: 2.1 time: 0.744124 Sep 15 08:57:57.049469 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:56 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1273 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:57.108114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-471d0a4b-11e5-4186-b757-8ef37012f908 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Calling method '.version_select at 0x7f1ec6929ca0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:57.342475 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-471d0a4b-11e5-4186-b757-8ef37012f908 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] HTTP exception thrown: Volume b86f7ac1-2b25-47c2-9120-b613d8730fb7 could not be found. Sep 15 08:57:57.343066 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-471d0a4b-11e5-4186-b757-8ef37012f908 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] Returning 404 to user: Volume b86f7ac1-2b25-47c2-9120-b613d8730fb7 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:57:57.351645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-471d0a4b-11e5-4186-b757-8ef37012f908 tempest-VolumesNegativeTest-1614681219 tempest-VolumesNegativeTest-1614681219-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/b86f7ac1-2b25-47c2-9120-b613d8730fb7" status: 404 len: 109 microversion: 2.1 time: 0.292930 Sep 15 08:57:57.352214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:57:57 2021] GET /compute/v2.1/os-volumes/b86f7ac1-2b25-47c2-9120-b613d8730fb7 => generated 109 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 08:57:57.601783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:57.617615 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d3db6bb0-ed47-49b0-91a8-e6df336dd596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1275 microversion: 2.1 time: 1.025269 Sep 15 08:57:57.631623 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 14/29] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:56 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1275 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:57.819850 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-516182043", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99cf6cad-714d-48b4-a18f-48890cca455e"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:57:58.067956 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:58.068940 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:58.096598 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:58.097064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:58.097876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:58.098333 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:59.674883 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:57:59.696640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-db91b069-4a40-4aaa-b4ad-7248044f6a00 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 1.644757 Sep 15 08:57:59.697651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 15/30] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:58 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:57:59.714796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:57:59.715792 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:57:59.743834 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:59.744352 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:57:59.745156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:57:59.745600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:00.056441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:00.092128 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-81dd9c54-917d-4bf1-953f-6e891a8c6a46 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1275 microversion: 2.1 time: 0.393289 Sep 15 08:58:00.094865 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:57:59 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1275 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:00.720854 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:00.721527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:00.743996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:00.744452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:00.745241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:00.749832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:02.940592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:02.968758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cde5030a-9366-4536-86f4-5e9a394747e2 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 2.258334 Sep 15 08:58:02.970474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 17/32] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:00 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:02.998422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:02.999382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:03.021011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:03.021715 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:03.022821 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:03.026666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:03.952776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:03.983816 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ea7185a6-e422-4cb1-b35c-5b3a835c40e8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 1.008299 Sep 15 08:58:03.984437 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 18/33] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:02 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:04.046479 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:04.047159 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:04.093817 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:04.106061 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:04.106061 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:04.106061 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:04.967339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:04.996768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7473b8c9-f829-420f-95e5-1bc3245bf70f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 1.010155 Sep 15 08:58:05.016791 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 19/34] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:03 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:05.439375 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0a484a0a-720e-4f75-997f-7fc8fa4a1281 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'create', calling method: .version_select at 0x7f1ec68688b0>, body: {"keypair": {"name": "tempest-keypair-152583117"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:05.528192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-0a484a0a-720e-4f75-997f-7fc8fa4a1281 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:05.536411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-0a484a0a-720e-4f75-997f-7fc8fa4a1281 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for user e26e692f5f7d4c8cb7dd9c0207ecf68f and project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:06.137839 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-0a484a0a-720e-4f75-997f-7fc8fa4a1281 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:06.161544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-0a484a0a-720e-4f75-997f-7fc8fa4a1281 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for user e26e692f5f7d4c8cb7dd9c0207ecf68f and project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:06.193776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0a484a0a-720e-4f75-997f-7fc8fa4a1281 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.174923 Sep 15 08:58:06.194439 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 20/35] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Sep 15 08:58:05 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:06.696101 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-6d10c845-c7dc-48f1-ab70-8ac2bb00c0bc req-d3d5e422-f78b-4d12-93c3-55c1f2025936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e110435-269e-4721-b7e3-37454d25489c", "tag": "3cba594d-903b-492b-a4d0-9d8c4dfb821f"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:06.704610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:06.704610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:58:06.721325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-6d10c845-c7dc-48f1-ab70-8ac2bb00c0bc req-d3d5e422-f78b-4d12-93c3-55c1f2025936 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:06.721999 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-6d10c845-c7dc-48f1-ab70-8ac2bb00c0bc req-d3d5e422-f78b-4d12-93c3-55c1f2025936 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:06.747420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-6d10c845-c7dc-48f1-ab70-8ac2bb00c0bc req-d3d5e422-f78b-4d12-93c3-55c1f2025936 service nova] Creating event network-changed:3cba594d-903b-492b-a4d0-9d8c4dfb821f for instance 4e110435-269e-4721-b7e3-37454d25489c on hv-cinder-80600 Sep 15 08:58:06.748299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-6d10c845-c7dc-48f1-ab70-8ac2bb00c0bc req-d3d5e422-f78b-4d12-93c3-55c1f2025936 service nova] Acquired lock "compute-rpcapi-router" {{(pid=89582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 15 08:58:06.750296 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20efd62a-60bb-4b4e-bce2-73d559066651 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:06.750991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20efd62a-60bb-4b4e-bce2-73d559066651 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:06.752174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20efd62a-60bb-4b4e-bce2-73d559066651 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:06.752971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20efd62a-60bb-4b4e-bce2-73d559066651 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:06.765095 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.compute.rpcapi [None req-20efd62a-60bb-4b4e-bce2-73d559066651 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Sep 15 08:58:06.770039 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20efd62a-60bb-4b4e-bce2-73d559066651 None None] Releasing lock "compute-rpcapi-router" {{(pid=89582) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 15 08:58:06.798914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-20efd62a-60bb-4b4e-bce2-73d559066651 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602890 Sep 15 08:58:06.799915 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 21/36] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:06.815247 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:06.815987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:06.824230 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:06.824675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:06.825449 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:06.825863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:07.218318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:07.229294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bf21cf57-2e27-40f5-a375-5081ca8bbbed tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.427783 Sep 15 08:58:07.240893 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 22/37] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:06 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:07.742124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bbac9fce-0264-4b88-af5b-0cdebf79a752 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'create', calling method: .version_select at 0x7f1ec688f820>, body: {"keypair": {"name": "tempest-keypair-2109361204"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:07.773108 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-bbac9fce-0264-4b88-af5b-0cdebf79a752 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:07.777545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-bbac9fce-0264-4b88-af5b-0cdebf79a752 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for user 662bcbb9a7fc49e8b1b2a3f4d8a2e100 and project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:07.916406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] validate_networks() for [('99cf6cad-714d-48b4-a18f-48890cca455e', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:58:08.186005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-bbac9fce-0264-4b88-af5b-0cdebf79a752 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:08.199886 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-bbac9fce-0264-4b88-af5b-0cdebf79a752 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for user 662bcbb9a7fc49e8b1b2a3f4d8a2e100 and project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:08.234585 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bbac9fce-0264-4b88-af5b-0cdebf79a752 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.990881 Sep 15 08:58:08.238369 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 23/38] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Sep 15 08:58:07 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 997 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 15 08:58:08.800683 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-94071d77-ec47-44f9-b402-eac8f3eaed89 req-420c42b0-f104-48a1-a018-5e0992553404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f", "tag": "763240a6-6f8f-4069-b175-a718036b4722"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:08.823314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:08.823314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:58:08.839353 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-94071d77-ec47-44f9-b402-eac8f3eaed89 req-420c42b0-f104-48a1-a018-5e0992553404 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:08.839996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-94071d77-ec47-44f9-b402-eac8f3eaed89 req-420c42b0-f104-48a1-a018-5e0992553404 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:08.860037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-94071d77-ec47-44f9-b402-eac8f3eaed89 req-420c42b0-f104-48a1-a018-5e0992553404 service nova] Creating event network-changed:763240a6-6f8f-4069-b175-a718036b4722 for instance 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f on hv-cinder-80600 Sep 15 08:58:08.865777 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-94071d77-ec47-44f9-b402-eac8f3eaed89 req-420c42b0-f104-48a1-a018-5e0992553404 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.624893 Sep 15 08:58:08.877061 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 24/39] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:08.898336 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:08.899126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:08.925539 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:08.925990 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:08.926801 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:08.927387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:09.399208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:58:09.399573 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:58:09.399744 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:58:09.400156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:58:09.400564 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:58:09.409723 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:09.410455 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:09.411661 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:09.412302 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:09.456007 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Getting quotas for project bd3fe44e1e5d42c0b4118a5b3004daac. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:09.467613 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Getting quotas for user efcacffc3cbd4391a1cb4fdc52ba381c and project bd3fe44e1e5d42c0b4118a5b3004daac. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:09.491595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:58:09.497747 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:58:09.663474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9b8cc99c-fb94-4f82-9c48-28de29c15fdd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 12.255430 Sep 15 08:58:09.664461 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 16/40] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:57:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 12257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 08:58:09.715567 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:09.716525 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:09.731640 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:09.736973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:09.736973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:09.736973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:09.852401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:09.868722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5fb0b240-25a4-4c80-9905-a50d64a0057b tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.990208 Sep 15 08:58:09.878764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 25/41] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:08 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:09.889897 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9f6839f5-b195-452d-a639-994b731d73f1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:09.890602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9f6839f5-b195-452d-a639-994b731d73f1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:10.042497 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9f6839f5-b195-452d-a639-994b731d73f1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:10.062525 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9f6839f5-b195-452d-a639-994b731d73f1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1221 microversion: 2.1 time: 0.191838 Sep 15 08:58:10.063345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 26/42] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:09 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:10.230450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1500100588", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99cf6cad-714d-48b4-a18f-48890cca455e"}]}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:10.308971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.network.neutron [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] validate_networks() for [('99cf6cad-714d-48b4-a18f-48890cca455e', None, None, None)] {{(pid=89582) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:58:10.442682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:10.463059 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-539075cb-56fb-409c-8889-594f6b1ac984 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.797399 Sep 15 08:58:10.466404 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 17/43] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:09 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:10.895408 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:10.898542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:10.914935 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:10.915680 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:10.917148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:10.921048 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:11.544689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:11.555598 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-72b610df-2f92-4291-bb9c-cc5257442f88 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.673546 Sep 15 08:58:11.566116 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 18/44] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:10 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:11.578540 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-842683387", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a7d9519-adcd-45df-bd0a-0005f95484a0"}], "security_groups": [{"name": "tempest-securitygroup--2038209204"}], "key_name": "tempest-keypair-152583117", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:11.762588 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] validate_networks() for [('2a7d9519-adcd-45df-bd0a-0005f95484a0', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:58:12.026602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Flavor limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:58:12.027134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Image limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:58:12.027515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Flavor pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:58:12.027921 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Image pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:58:12.028361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:58:12.036971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.037483 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:12.038333 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.038757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:12.080421 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Getting quotas for project bd3fe44e1e5d42c0b4118a5b3004daac. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:12.086401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Getting quotas for user efcacffc3cbd4391a1cb4fdc52ba381c and project bd3fe44e1e5d42c0b4118a5b3004daac. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:12.099533 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Going to run 1 instances... {{(pid=89582) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:58:12.102935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:58:12.283825 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3cf00306-8f85-47b6-a6b5-bebb0418be5b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.063710 Sep 15 08:58:12.289609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 27/45] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:58:10 2021] POST /compute/v2.1/servers => generated 383 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 08:58:12.302916 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:12.303947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:12.314749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.315389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:12.316296 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.317570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:12.598817 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:12.609013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-08f307a3-1576-4b92-99a4-478f926a8818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.317899 Sep 15 08:58:12.609686 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 28/46] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:12 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:12.622705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-efcdf95d-eaad-4d69-9b33-fb58d2b716ad tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:12.623617 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-efcdf95d-eaad-4d69-9b33-fb58d2b716ad tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:12.715029 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:58:12.715656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:58:12.715916 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:58:12.716328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:58:12.716746 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:58:12.728640 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.729094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:12.731958 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.734234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:12.758565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:12.773548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for user e26e692f5f7d4c8cb7dd9c0207ecf68f and project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:12.789435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:58:12.791899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:58:12.857211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-efcdf95d-eaad-4d69-9b33-fb58d2b716ad tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:12.865998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-efcdf95d-eaad-4d69-9b33-fb58d2b716ad tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1222 microversion: 2.1 time: 0.254236 Sep 15 08:58:12.866898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 29/47] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:12 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:12.877062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:12.882995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:12.885215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.885648 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:12.887002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:12.887471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:13.004156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f43a5f5a-d553-45db-8eda-62ca7203f416 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.436671 Sep 15 08:58:13.005868 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 19/48] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:58:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 08:58:13.070569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b11babb8-e960-4de8-9082-c9ca312e5d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:13.071727 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b11babb8-e960-4de8-9082-c9ca312e5d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:13.177210 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:13.189418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cad72012-9a60-4e63-983b-8b8f142553c9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.321258 Sep 15 08:58:13.191030 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 30/49] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:12 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:13.335274 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b11babb8-e960-4de8-9082-c9ca312e5d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:13.348331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b11babb8-e960-4de8-9082-c9ca312e5d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1236 microversion: 2.1 time: 0.335274 Sep 15 08:58:13.349099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 20/50] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:13 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1236 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:13.631931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:13.632854 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:13.641069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:13.641584 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:13.642418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:13.642851 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:13.862420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:13.871494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fd88dc93-809a-4f1d-9f03-806a293dc705 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.248213 Sep 15 08:58:13.872026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 31/51] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:13 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:13.890857 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:13.894253 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:13.898797 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:13.899248 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:13.900021 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:13.900455 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:14.074238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:14.082269 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-670bde57-ffe7-4e4f-9ba1-7a447993f66d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1226 microversion: 2.1 time: 0.200444 Sep 15 08:58:14.082803 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 21/52] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:13 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:14.212740 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:14.213346 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:14.221088 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:14.221609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:14.222376 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:14.222808 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:14.374313 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:14.375118 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:14.382535 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:14.382984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:14.383746 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:14.384168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:14.433572 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:14.446473 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d9c14959-2f6f-457b-9d60-22746b2ea755 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.242802 Sep 15 08:58:14.447774 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 32/53] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:14 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:14.468936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-816259588", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dee31690-1b17-41a7-9226-bbc0b9faff0c"}], "security_groups": [{"name": "tempest-securitygroup--1333544244"}], "key_name": "tempest-keypair-2109361204", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:14.541755 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:14.550332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2c4d5032-f79b-4422-98f3-c6c849b382b4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1240 microversion: 2.1 time: 0.185397 Sep 15 08:58:14.551718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 22/54] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:14 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1240 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:14.665762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.network.neutron [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] validate_networks() for [('dee31690-1b17-41a7-9226-bbc0b9faff0c', None, None, None)] {{(pid=89582) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:58:14.894022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:14.894722 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:14.902066 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:14.902794 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:14.903597 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:14.904027 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.130716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:15.140899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9eca55d3-c406-42d7-88f1-4c6cbff10ffa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.256322 Sep 15 08:58:15.150979 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 23/55] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:14 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:15.162813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:15.163421 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:15.171651 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.172175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.173046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.173552 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.298785 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:15.303407 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Flavor limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:58:15.303925 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Image limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:58:15.304828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Flavor pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:58:15.305691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Image pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:58:15.306282 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:58:15.307266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f5c81a63-936d-48b4-a94d-f13c19618cb7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1226 microversion: 2.1 time: 0.155013 Sep 15 08:58:15.309011 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 24/56] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:15 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:15.320345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.320790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.321579 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.322011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.339082 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:58:15.342953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for user 662bcbb9a7fc49e8b1b2a3f4d8a2e100 and project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:58:15.353199 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Going to run 1 instances... {{(pid=89582) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:58:15.355881 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:58:15.465570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fcedf7c5-3604-463e-a078-5cf14caf6709 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.016461 Sep 15 08:58:15.469457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:15.470305 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:15.472000 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 33/57] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Sep 15 08:58:14 2021] POST /compute/v2.1/servers => generated 402 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 08:58:15.480981 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.481643 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.482709 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.483286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.484627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4a5b9d1b-09af-4423-9641-c7647c28c81c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:15.485275 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4a5b9d1b-09af-4423-9641-c7647c28c81c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:15.675704 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4a5b9d1b-09af-4423-9641-c7647c28c81c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:15.704641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4a5b9d1b-09af-4423-9641-c7647c28c81c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:15.714164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4a5b9d1b-09af-4423-9641-c7647c28c81c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:15.715789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4a5b9d1b-09af-4423-9641-c7647c28c81c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1281 microversion: 2.20 time: 0.242782 Sep 15 08:58:15.716316 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 34/58] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:15 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:15.727564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:15.728380 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:15.736796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.737419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.738397 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:15.738980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:15.790499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:15.799984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7907c527-c90d-4c1a-9975-f82743b19a72 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.339774 Sep 15 08:58:15.801589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 25/59] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:15 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:16.116438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:16.128233 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d56bb0e7-2174-43c0-9c45-a61dad9f2d3e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1240 microversion: 2.1 time: 0.410532 Sep 15 08:58:16.133348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 35/60] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:15 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1240 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:16.169129 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:16.169734 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:16.188341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.188852 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.189634 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.190064 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.330043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:16.331273 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:16.339130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.340223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.341171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.341607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.436020 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:16.458658 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b049bbf0-f817-478a-9270-49ffb377f2ad tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.305123 Sep 15 08:58:16.460955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 26/61] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:16 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:16.486160 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:16.495188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-67234e74-f9c9-4134-89b6-384ed86d66c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1218 microversion: 2.1 time: 0.174295 Sep 15 08:58:16.496085 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 36/62] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:16 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:16.739715 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:16.740316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:16.748792 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.749307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.750080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.750543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.823051 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:16.824491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:16.832249 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.832866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.833796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:16.834382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:16.976974 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:16.998393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:17.006803 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:17.006803 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1bdfe1fa-8ffc-4d6c-bde3-2674f4224e07 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1285 microversion: 2.20 time: 0.275397 Sep 15 08:58:17.006803 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 27/63] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:16 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:17.059721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:17.067586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-008080b8-e29c-417d-a4d2-c1b95063d438 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.254452 Sep 15 08:58:17.068114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 37/64] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:16 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:17.152383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:17.153199 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:17.161343 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:17.161980 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:17.163054 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:17.163482 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:17.289594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:17.297686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7bfdbbe7-18f4-451b-9969-4e904a6cca1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1232 microversion: 2.1 time: 0.156034 Sep 15 08:58:17.298220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 28/65] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:17 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1232 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:17.481642 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:17.482265 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:17.489304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:17.489743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:17.490801 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:17.491232 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:17.519009 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:17.519618 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:17.527392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:17.528017 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:17.528802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:17.529222 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:17.648544 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:17.657164 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b3a69fcf-31f7-437e-85e8-34adb17871d2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1218 microversion: 2.1 time: 0.147292 Sep 15 08:58:17.657757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 29/66] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:17 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:17.695432 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:17.703439 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-86ad1928-a9ee-405f-97b9-932fb6422818 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.231376 Sep 15 08:58:17.704001 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 38/67] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:17 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:18.029558 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:18.030191 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:18.038568 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.039077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.039978 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.040521 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.092379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:18.093234 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:18.100437 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.101075 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.101982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.102582 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.171984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:18.188539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:18.194853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:18.196235 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4187eed0-01ff-43c0-8e8f-7ddb10b24f76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1285 microversion: 2.20 time: 0.176206 Sep 15 08:58:18.202228 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 30/68] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:18 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:18.312974 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:18.321545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fa718356-a8e8-4353-b6b6-75eaa8c5d970 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.240536 Sep 15 08:58:18.322469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 39/69] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:18 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:18.332303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:18.332973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:18.341023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.341488 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.342606 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.343040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.514975 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:18.522939 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-faf010a6-f914-4b34-a9f2-99817f09222f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1232 microversion: 2.1 time: 0.210319 Sep 15 08:58:18.523471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 31/70] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:18 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1232 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:18.680084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:18.680672 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:18.689397 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.690289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.691061 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.691775 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.734231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:18.739200 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:18.755347 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.758677 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:18.759654 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:18.760055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.017066 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:19.025506 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5690751b-891d-494d-85cf-6a9292015fb3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1218 microversion: 2.1 time: 0.356532 Sep 15 08:58:19.025809 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:19.027302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 40/71] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:18 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1218 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:19.044179 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7f23b379-ed8e-4adf-adcd-1d43eceb4ea9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.319157 Sep 15 08:58:19.044885 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 32/72] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:18 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:19.220346 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:19.221184 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:19.228370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.228912 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.229760 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.230907 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.344765 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:19.345483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:19.352853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.353559 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.354037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.354483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.370921 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:19.398329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:19.406465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:19.407575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dd1b1ce7-f1ec-4898-9c1a-472825a4d87b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1277 microversion: 2.20 time: 0.196915 Sep 15 08:58:19.408501 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 41/73] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:19 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:19.548805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:19.549349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:19.562353 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.565021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.565870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.567560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.611134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:19.637817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6a2db8f6-6e92-4a1e-a44f-b60c3766b4d9 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.302704 Sep 15 08:58:19.638636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 33/74] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:19 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:19.796942 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:19.798872 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-ad1d2141-b3f5-4c58-ad27-5ab11735bdfc req-22ff5bd2-77f6-4ca0-a2b0-9ccf65066011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d8f72b-fc30-41ab-922d-6e83c2b253e1", "tag": "fd7b9192-1dcd-4cd1-8019-0543a7285ecc"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:19.806254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c80d8a64-7a80-477b-9494-213f57ae8dd5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1288 microversion: 2.1 time: 0.270972 Sep 15 08:58:19.806964 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:19.806964 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:58:19.808833 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 42/75] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:19 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1288 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:19.815382 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-ad1d2141-b3f5-4c58-ad27-5ab11735bdfc req-22ff5bd2-77f6-4ca0-a2b0-9ccf65066011 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.815824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-ad1d2141-b3f5-4c58-ad27-5ab11735bdfc req-22ff5bd2-77f6-4ca0-a2b0-9ccf65066011 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.832962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-ad1d2141-b3f5-4c58-ad27-5ab11735bdfc req-22ff5bd2-77f6-4ca0-a2b0-9ccf65066011 service nova] Creating event network-changed:fd7b9192-1dcd-4cd1-8019-0543a7285ecc for instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 on hv-cinder-80600 Sep 15 08:58:19.833475 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-ad1d2141-b3f5-4c58-ad27-5ab11735bdfc req-22ff5bd2-77f6-4ca0-a2b0-9ccf65066011 service nova] Acquired lock "compute-rpcapi-router" {{(pid=89583) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 15 08:58:19.834601 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc1c4500-9c7d-4a86-9f94-d95e7ce26309 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.835039 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc1c4500-9c7d-4a86-9f94-d95e7ce26309 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.835819 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc1c4500-9c7d-4a86-9f94-d95e7ce26309 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:19.836252 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc1c4500-9c7d-4a86-9f94-d95e7ce26309 None None] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:19.845179 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.compute.rpcapi [None req-dc1c4500-9c7d-4a86-9f94-d95e7ce26309 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Sep 15 08:58:19.846045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc1c4500-9c7d-4a86-9f94-d95e7ce26309 None None] Releasing lock "compute-rpcapi-router" {{(pid=89583) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 15 08:58:19.869512 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dc1c4500-9c7d-4a86-9f94-d95e7ce26309 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080307 Sep 15 08:58:19.870124 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 34/76] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:58:20.048677 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:20.049464 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:20.057639 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.058693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.059541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.060038 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.067490 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:20.068183 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:20.076583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.077025 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.077794 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.078251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.231286 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:20.239417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2c7aab57-b2a7-4ea3-9a18-e732dc695e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1218 microversion: 2.1 time: 0.200591 Sep 15 08:58:20.239941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 43/77] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:20 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:20.314795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:20.322991 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6ec4028b-1fc1-46af-b10e-89f06d594e8e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.265819 Sep 15 08:58:20.324236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 35/78] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:20 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:20.439803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:20.440424 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:20.447449 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.447879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.448709 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.449120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.570405 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:20.583673 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:20.589727 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:20.590790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5b0395af-fe41-4ade-8e0d-df99c42032ce tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1277 microversion: 2.20 time: 0.160876 Sep 15 08:58:20.591298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 44/79] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:20 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:20.664620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:20.665221 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:20.675618 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.676631 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.677410 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.677899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.829152 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:20.829766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:20.837092 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.837620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.838414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:20.838837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:20.882448 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:20.890480 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d708a5f3-e437-4c91-b679-62c01c25b862 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.239495 Sep 15 08:58:20.891013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 36/80] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:20 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:20.963768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:20.972901 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1dc9b535-7e7e-401b-8cf3-c56322e1cdff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1288 microversion: 2.1 time: 0.152920 Sep 15 08:58:20.973420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 45/81] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:20 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:21.262059 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:21.262670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:21.269763 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.270233 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.270976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.271397 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.346146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:21.346746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:21.353878 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.354351 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.355116 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.355536 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.393913 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:21.402364 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cf9a2036-9d04-4957-8341-f4c9f5ff8ddb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1218 microversion: 2.1 time: 0.149248 Sep 15 08:58:21.402902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 37/82] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:21 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:21.562545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:21.570535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-df6f5bc3-0cd3-4692-a797-726a92b42514 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.234098 Sep 15 08:58:21.571048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 46/83] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:21 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:21.614057 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:21.614690 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:21.623394 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.623829 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.624589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.626063 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.748413 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:21.761979 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:21.768149 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:21.769166 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-12153b11-114f-4916-a3f1-e353bbfade18 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1277 microversion: 2.20 time: 0.164314 Sep 15 08:58:21.769969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 38/84] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:21 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:21.912289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:21.912890 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:21.920892 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.921335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.922146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:21.922577 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:21.995152 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:21.996436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:22.003663 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.004100 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.005066 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.005486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.135163 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:22.143681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-720ce4cc-16b2-4faa-b85d-e376213e88df tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1288 microversion: 2.1 time: 0.157863 Sep 15 08:58:22.144438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 39/85] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:21 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1288 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:22.286349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:22.303800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3293e973-714c-4395-8bb2-9945e74ee851 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.400589 Sep 15 08:58:22.304355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 47/86] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:21 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:22.424240 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:22.424843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:22.432565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.433054 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.433838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.434288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.560662 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:22.568710 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-521cbd10-e6aa-442b-9079-1d389346e95c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1218 microversion: 2.1 time: 0.154359 Sep 15 08:58:22.569227 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 40/87] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:22 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:22.593536 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:22.594174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:22.601365 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.601804 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.602599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.603024 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.792925 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:22.793533 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:22.801089 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.801622 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.802601 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:22.803115 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:22.807213 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:22.815376 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-61799d8c-cf58-44d9-90ce-035283d753dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.231623 Sep 15 08:58:22.815899 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 48/88] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:22 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:22.925703 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:22.939032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:22.945173 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:22.946224 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dc404346-22b3-4f76-954e-4315cd1b495b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1277 microversion: 2.20 time: 0.162824 Sep 15 08:58:22.946743 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 41/89] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:22 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:23.166158 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:23.166773 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:23.173926 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.174395 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.175149 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.175575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.296125 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:23.303883 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bf79eb5a-0d47-4244-b09e-727015049e9b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1296 microversion: 2.1 time: 0.146973 Sep 15 08:58:23.304409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 49/90] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:23 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1296 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:23.326168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:23.326771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:23.333866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.334338 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.335091 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.335516 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.530818 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:23.539026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4f6ebed6-a55f-4cd7-a4da-b66a8eae9b97 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.222607 Sep 15 08:58:23.539543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 42/91] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:23 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:23.589900 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:23.590521 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:23.597644 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.598097 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.598874 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.599300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.725283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:23.733768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7591c85e-e0e7-4490-84d8-f0131c743fcb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1274 microversion: 2.1 time: 0.153000 Sep 15 08:58:23.734533 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 50/92] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:23 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:23.837673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:23.838418 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:23.846549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.847072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.847928 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.848434 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.970475 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:23.971303 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:23.979260 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.979796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:23.981136 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:23.981572 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:24.075853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:24.084073 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7028b120-70a4-4e00-ad52-77ef9481ba1e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.255622 Sep 15 08:58:24.084602 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 43/93] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:23 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:24.109580 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:24.123110 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:24.129270 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:24.130339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-034533f3-9388-490d-b3de-5fa9342393eb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1277 microversion: 2.20 time: 0.169838 Sep 15 08:58:24.130849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 51/94] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:23 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:24.326932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:24.327530 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:24.334601 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:24.335040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:24.335791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:24.336215 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:24.456796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:24.465592 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1b802245-9eba-4376-82a4-2a41b813f0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1296 microversion: 2.1 time: 0.148304 Sep 15 08:58:24.466152 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 44/95] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:24 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1296 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:24.562244 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:24.562992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:24.570146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:24.570594 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:24.571355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:24.571780 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:24.756619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:24.757333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:24.765314 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:24.765833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:24.766711 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:24.767208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:24.809394 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:24.820018 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cd97a070-c7e2-4a81-af3a-8a35c0cb30d4 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.267489 Sep 15 08:58:24.830138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 52/96] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:24 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:24.910877 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:24.921598 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-717f46e5-bfbb-4917-8618-470121713531 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1274 microversion: 2.1 time: 0.174275 Sep 15 08:58:24.931602 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 45/97] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:24 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:25.107634 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:25.108481 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:25.116705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.117315 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:25.118282 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.118844 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:25.177853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:25.178492 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:25.207338 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.207789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:25.210160 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.210609 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:25.500271 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:25.545878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:25.559288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:25.560420 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-69c098c0-7319-4f94-ba24-72572844a7e2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1277 microversion: 2.20 time: 0.406392 Sep 15 08:58:25.574437 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 46/98] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:25 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1277 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:25.597164 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:25.597797 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:25.620615 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.621131 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:25.624452 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.624891 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:25.677466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:25.695102 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-66967185-50d9-4523-a703-f5fb5d08b7f3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.598126 Sep 15 08:58:25.695656 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 53/99] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:25 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:25.842889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:25.843493 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:25.864135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.865958 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:25.867113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:25.867693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:26.022650 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:26.048709 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f3d999d8-dc65-406b-8bb6-895b14d720f6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1306 microversion: 2.1 time: 0.467889 Sep 15 08:58:26.048709 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 47/100] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:25 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1306 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:26.216553 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-93f9ce86-78a3-41dc-9815-491dc72bb492 req-a5ed1d9e-769a-4515-9ef1-0c0cec14c895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e110435-269e-4721-b7e3-37454d25489c", "name": "network-vif-plugged", "status": "completed", "tag": "3cba594d-903b-492b-a4d0-9d8c4dfb821f"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:26.236924 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:26.236924 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:58:26.271229 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-93f9ce86-78a3-41dc-9815-491dc72bb492 req-a5ed1d9e-769a-4515-9ef1-0c0cec14c895 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:26.272165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-93f9ce86-78a3-41dc-9815-491dc72bb492 req-a5ed1d9e-769a-4515-9ef1-0c0cec14c895 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:26.339945 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-93f9ce86-78a3-41dc-9815-491dc72bb492 req-a5ed1d9e-769a-4515-9ef1-0c0cec14c895 service nova] Creating event network-vif-plugged:3cba594d-903b-492b-a4d0-9d8c4dfb821f for instance 4e110435-269e-4721-b7e3-37454d25489c on hv-cinder-80600 Sep 15 08:58:26.353952 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-93f9ce86-78a3-41dc-9815-491dc72bb492 req-a5ed1d9e-769a-4515-9ef1-0c0cec14c895 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289309 Sep 15 08:58:26.354741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 48/101] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:26.389214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:26.389843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:26.408742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:26.409192 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:26.409969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:26.410428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:26.709149 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:26.733816 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-138e81a0-47fa-424a-8bd3-55fff0260ca1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1282 microversion: 2.1 time: 0.371383 Sep 15 08:58:26.734692 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 49/102] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:26 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1282 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:26.756319 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:26.756934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:26.758841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:26.775555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:26.776003 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:26.778497 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2469ac20-e565-47f8-819c-31f4418c49cd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.945291 Sep 15 08:58:26.778956 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:26.779761 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 54/103] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:25 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:26.785494 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:26.813074 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:26.813908 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:26.827150 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:26.827864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:26.832349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:26.833114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:27.108727 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:27.150858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:27.168411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:27.178452 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fe589eec-80fc-4338-95a5-1825184f3dbf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1341 microversion: 2.20 time: 0.433676 Sep 15 08:58:27.179368 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 50/104] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:26 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1341 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:27.209694 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:27.217854 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:27.228664 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:27.233007 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:27.234003 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:27.234612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:27.573972 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:27.585158 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-192785d8-0443-49cc-a43e-5637dae8a43b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1294 microversion: 2.1 time: 0.404371 Sep 15 08:58:27.594234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 51/105] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:27 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1294 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:27.640812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:27.663624 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9c7014ba-0f7e-4ba0-9976-7891fd60ada5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.882458 Sep 15 08:58:27.664172 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 55/106] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:26 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:27.756645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:27.757638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:27.765449 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:27.765896 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:27.766859 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:27.767122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:27.804699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:27.805876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:27.814183 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:27.815193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:27.816164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:27.816790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:28.038352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:28.055502 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5ead9f89-3ec6-4f99-a93b-5ce99000c265 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1280 microversion: 2.1 time: 0.307814 Sep 15 08:58:28.070401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 52/107] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:27 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:28.219146 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:28.220352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:28.242711 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:28.248946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:28.249445 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:28.254306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:28.254754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:28.267220 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ef92a70a-6577-4746-8425-b937a7852754 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.474595 Sep 15 08:58:28.268110 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 56/108] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:27 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:28.387410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-9233d38a-9749-41f2-aa6c-e299b1ed7232 req-542bbee3-6b4d-4eea-9eec-8bd95e84be21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f", "name": "network-vif-plugged", "status": "completed", "tag": "763240a6-6f8f-4069-b175-a718036b4722"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:28.422465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:28.422465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:58:28.437113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-9233d38a-9749-41f2-aa6c-e299b1ed7232 req-542bbee3-6b4d-4eea-9eec-8bd95e84be21 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:28.437814 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-9233d38a-9749-41f2-aa6c-e299b1ed7232 req-542bbee3-6b4d-4eea-9eec-8bd95e84be21 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:28.476541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-9233d38a-9749-41f2-aa6c-e299b1ed7232 req-542bbee3-6b4d-4eea-9eec-8bd95e84be21 service nova] Creating event network-vif-plugged:763240a6-6f8f-4069-b175-a718036b4722 for instance 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f on hv-cinder-80600 Sep 15 08:58:28.492766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-9233d38a-9749-41f2-aa6c-e299b1ed7232 req-542bbee3-6b4d-4eea-9eec-8bd95e84be21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120950 Sep 15 08:58:28.493653 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 57/109] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:58:28.613494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:28.615772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:28.634431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:28.635226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:28.637099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:28.637539 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:28.955702 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:28.970993 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:28.977410 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:28.978819 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-074cbf64-e704-45e1-8e36-ddd945388032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1339 microversion: 2.20 time: 0.778607 Sep 15 08:58:28.980001 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 53/110] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:28 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1339 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:28.990486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:28.993315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:29.000201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:29.000905 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:29.001883 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:29.002540 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:29.156417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:29.173844 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3a3d4ad6-b177-4a29-81d1-092740241725 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.575412 Sep 15 08:58:29.175017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 58/111] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:28 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:29.191068 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:29.191691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:29.199577 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:29.202215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:29.202215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:29.202215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:29.628145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:29.641593 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-713a2a87-4b24-47b8-8669-16549c6d50a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.660234 Sep 15 08:58:29.650630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 54/112] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:28 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:29.662646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:29.663334 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:29.671683 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:29.672202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:29.673236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:29.673727 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:29.804434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:29.813297 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ecde8a93-d32a-4bd7-80ee-472177f485fb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.636803 Sep 15 08:58:29.814021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 59/113] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:29 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:29.904736 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-dec5c0cc-82be-4591-8fd6-6414c4b920a0 req-e1cfc0fb-d8b2-4812-bd86-ca32eae89d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661af67d-f3ef-4c65-bcb6-a51b229ddbf0", "tag": "afdabbd5-43b9-4136-8495-2bdae211bde3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:29.909969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:29.921070 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2854578e-fe10-4e08-a79d-7e54f731d72a tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.269012 Sep 15 08:58:29.927473 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:29.927473 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:58:29.931603 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 55/114] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:29 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:29.951195 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-dec5c0cc-82be-4591-8fd6-6414c4b920a0 req-e1cfc0fb-d8b2-4812-bd86-ca32eae89d6b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:29.951965 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-dec5c0cc-82be-4591-8fd6-6414c4b920a0 req-e1cfc0fb-d8b2-4812-bd86-ca32eae89d6b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:29.971319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-dec5c0cc-82be-4591-8fd6-6414c4b920a0 req-e1cfc0fb-d8b2-4812-bd86-ca32eae89d6b service nova] Creating event network-changed:afdabbd5-43b9-4136-8495-2bdae211bde3 for instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 on hv-cinder-80600 Sep 15 08:58:29.977471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-dec5c0cc-82be-4591-8fd6-6414c4b920a0 req-e1cfc0fb-d8b2-4812-bd86-ca32eae89d6b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083400 Sep 15 08:58:29.978057 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 60/115] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:58:30.005997 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:30.006634 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:30.014132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.014613 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:30.015393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.015817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:30.199127 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:30.199829 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:30.207205 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.207644 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:30.208407 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.208833 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:30.441618 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:30.450472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fdaf4882-a245-4b5f-9368-140ddac25b1b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.262383 Sep 15 08:58:30.451015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 61/116] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:30 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:30.663462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:30.663963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:30.671332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.671778 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:30.672553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.672981 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:30.911921 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:30.920785 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7bd4e8f6-b4d6-49e3-a110-620bcd03324b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.266462 Sep 15 08:58:30.921319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 62/117] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:30 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:30.931361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:30.931963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:30.940203 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.940650 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:30.941409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:30.941839 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:31.161802 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:31.173291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-91cde6d5-a6a8-4a46-bfa0-9628692d2d4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.250118 Sep 15 08:58:31.173910 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 63/118] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:30 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:31.186451 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:31.187258 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:31.194459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:31.194902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:31.195670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:31.196102 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:31.217072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:31.232356 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:31.238726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:31.239863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cef97d1b-fc16-4929-82ab-e7eee2de1d7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 1.243037 Sep 15 08:58:31.240481 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 56/119] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:29 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:31.409326 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:31.421042 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f11a9b68-5d6e-4dae-94ba-3f5c37487392 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.245521 Sep 15 08:58:31.421932 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 64/120] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:31 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:31.473217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:31.473837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:31.481892 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:31.482377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:31.483179 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:31.483799 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:31.954488 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:31.957531 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:31.981815 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:31.988643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:31.988643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:31.988643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:32.272589 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:32.283837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8f57eb7e-4617-4b79-aa49-d51446d5bcc1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.350164 Sep 15 08:58:32.293393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 65/121] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:31 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:32.295938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:32.296548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:32.301439 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:32.304746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:32.305193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:32.305970 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:32.306466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:32.328923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ce52e878-99ae-4a16-a2b3-c8e2e3b92a0b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.865373 Sep 15 08:58:32.333244 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 57/122] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:31 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:32.352552 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:32.353348 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:32.361443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:32.362272 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:32.363772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:32.364496 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:32.642431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:32.652870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-eba61a8a-ca0d-45d8-83b7-206bf24f4a16 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.366993 Sep 15 08:58:32.653819 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 66/123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:32 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:32.666445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:32.673155 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:32.679557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:32.680545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:32.681354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:32.681927 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:32.913879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:32.925589 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bbaf3826-0686-4021-bff9-4899bfa20789 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.270508 Sep 15 08:58:32.935018 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 67/124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:32 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:32.942076 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:32.958828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:32.968464 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:32.970162 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cbd44850-8492-43e5-9ccc-9e382e204bca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.635155 Sep 15 08:58:32.976012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 58/125] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:32 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:33.314502 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:33.315462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:33.337764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.340695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.341756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.342424 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.359334 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:33.361023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:33.377638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.378098 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.378897 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.379316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.633948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:33.643018 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6e6a4604-65e4-4d34-849e-deb6e4bfb2c0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.344290 Sep 15 08:58:33.643648 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 68/126] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:33 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:33.674229 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:33.674838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:33.682130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.683115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.683887 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.684858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.915180 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:33.924350 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a2306acf-bcc8-4c4d-8344-913f5e07db77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.259259 Sep 15 08:58:33.933248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 69/127] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:33 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:33.955336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:33.962554 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:33.963158 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:33.963707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-508b422e-ea2c-4c20-b324-73de982421a9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.618856 Sep 15 08:58:33.964248 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 59/128] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:33 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:33.972184 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.972623 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.973388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:33.973810 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:33.995658 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:33.996187 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:34.004461 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:34.004910 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:34.005678 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:34.006124 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:34.239196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:34.253974 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b21aaa9b-421e-4565-bac9-137c35346094 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.314411 Sep 15 08:58:34.254820 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 70/129] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:33 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:34.269613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-f3098323-b603-48cc-99c8-a9d381d229c9 req-2552c404-f2ee-4875-a813-7d90d9233cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba14ca7-eb88-437e-9c49-5101925f639b", "tag": "314b817f-9c79-46cf-a672-a625eea4af10"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:34.273048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:34.273048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:58:34.282078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-f3098323-b603-48cc-99c8-a9d381d229c9 req-2552c404-f2ee-4875-a813-7d90d9233cf8 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:34.282546 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-f3098323-b603-48cc-99c8-a9d381d229c9 req-2552c404-f2ee-4875-a813-7d90d9233cf8 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:34.304168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-f3098323-b603-48cc-99c8-a9d381d229c9 req-2552c404-f2ee-4875-a813-7d90d9233cf8 service nova] Creating event network-changed:314b817f-9c79-46cf-a672-a625eea4af10 for instance 5ba14ca7-eb88-437e-9c49-5101925f639b on hv-cinder-80600 Sep 15 08:58:34.309962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-f3098323-b603-48cc-99c8-a9d381d229c9 req-2552c404-f2ee-4875-a813-7d90d9233cf8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053751 Sep 15 08:58:34.310607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 71/130] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:34.406215 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:34.420014 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:34.426149 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:34.427183 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ebe51a9a-ff89-46a5-bb78-74d538b0833b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.442423 Sep 15 08:58:34.427696 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 60/131] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:33 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:34.664722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:34.665410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:34.672879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:34.673321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:34.674097 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:34.674541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:34.880327 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:34.889241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e57f649b-912c-4d4e-a442-c55a14594c0b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.234085 Sep 15 08:58:34.889787 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 72/132] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:34 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:34.946258 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:34.946859 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:34.956184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:34.956631 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:34.957396 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:34.957866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:34.987220 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:34.990466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:35.000176 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.000609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:35.002637 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.002637 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:35.268479 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:35.279416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b3c8dfc7-d5d6-4be0-82df-9ff883f1567c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.302685 Sep 15 08:58:35.286243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 73/133] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:34 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:35.291592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:35.292881 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:35.301810 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.302317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:35.303062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.303485 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:35.305315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:35.313897 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e04ebc8a-32e8-4b5e-8c0c-ad07e2861f46 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.377013 Sep 15 08:58:35.323690 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 61/134] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:34 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:35.450639 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:35.451264 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:35.458397 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.458833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:35.459585 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.460128 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:35.504341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:35.512503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c31dd7fb-d5f7-4639-83fd-9fcc8ee8b4eb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.231496 Sep 15 08:58:35.513216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 74/135] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:35 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:35.668039 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:35.682012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:35.689719 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:35.691101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0353a1bc-dbcf-4dab-836c-e2d3b00ec3a3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.249913 Sep 15 08:58:35.701501 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 62/136] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:35 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:35.916048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:35.917397 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:35.925497 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.926192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:35.927154 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:35.927582 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.138201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:36.146684 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b312e834-41cf-4cd0-92f2-4553fc06436f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.242059 Sep 15 08:58:36.156850 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 75/137] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:35 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:36.302106 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:36.302715 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:36.309959 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.310438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.311203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.311635 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.335220 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:36.335823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:36.343588 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.344031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.344789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.345214 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.526121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:36.534303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-33aa64ae-6b02-4038-b2e5-b65eea279ff4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.241569 Sep 15 08:58:36.534863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 63/138] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:36 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:36.544674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-8cd01bbd-0550-4ecf-a776-bca21b076fcb req-28594945-62b2-49ab-a984-ed988751fb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc1c15f-24f5-496f-a675-9771d0025292", "tag": "834d7008-fc0a-404f-8253-016e3f7d8ca2"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:36.551037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:36.551037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:58:36.559816 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-8cd01bbd-0550-4ecf-a776-bca21b076fcb req-28594945-62b2-49ab-a984-ed988751fb45 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.560289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-8cd01bbd-0550-4ecf-a776-bca21b076fcb req-28594945-62b2-49ab-a984-ed988751fb45 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.576520 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-8cd01bbd-0550-4ecf-a776-bca21b076fcb req-28594945-62b2-49ab-a984-ed988751fb45 service nova] Creating event network-changed:834d7008-fc0a-404f-8253-016e3f7d8ca2 for instance 9bc1c15f-24f5-496f-a675-9771d0025292 on hv-cinder-80600 Sep 15 08:58:36.581174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-8cd01bbd-0550-4ecf-a776-bca21b076fcb req-28594945-62b2-49ab-a984-ed988751fb45 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045210 Sep 15 08:58:36.581813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 64/139] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:36.594441 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:36.595201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:36.602592 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.603042 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.603819 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.604287 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.689649 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:36.697683 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8fa77b52-db99-4b74-9aa5-6735bb0315be tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.371564 Sep 15 08:58:36.698858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 76/140] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:36 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:36.714256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:36.714847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:36.723187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.723839 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.724818 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:36.725417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:36.812467 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:36.821116 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6972588c-c05d-4a37-b79e-9ae91ec420cb tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.238128 Sep 15 08:58:36.821651 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 65/141] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:36 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:36.930762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:36.944454 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:36.950565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:36.951617 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3eb785ff-a6e0-44ad-bc41-58f7916d7aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.246324 Sep 15 08:58:36.952112 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 77/142] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:36 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:37.169528 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:37.170167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:37.177271 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.177707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.178487 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.178933 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.380093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:37.387911 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b2f1c506-4343-45aa-8276-5a8672437a6a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.228029 Sep 15 08:58:37.388425 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 66/143] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:37 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:37.556183 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:37.556785 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:37.564061 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.564497 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.565251 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.565674 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.720775 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:37.721371 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:37.728609 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.729040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.729792 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.730249 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.768453 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:37.777361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9fd65d74-0c66-4ec8-a5b8-be8987f2cfb4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.230186 Sep 15 08:58:37.778140 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 78/144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:37 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:37.843844 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:37.844402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:37.851480 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.851920 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.852682 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.853109 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.931884 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:37.940004 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c4b7e548-013f-4608-821f-9068a1f529ac tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.228974 Sep 15 08:58:37.940706 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 67/145] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:37 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:37.975335 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:37.976331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:37.984412 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.985090 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:37.986525 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:37.987184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:38.146072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:38.155833 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-69be5793-1773-44da-b677-a3eabcaa1698 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1315 microversion: 2.1 time: 0.321712 Sep 15 08:58:38.158116 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 79/146] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:37 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:38.279964 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:38.293464 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:38.299573 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:38.300620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3d2bbbaf-bb23-4a47-8667-c4642958be06 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.335250 Sep 15 08:58:38.301385 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 68/147] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:37 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:38.411220 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:38.411826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:38.420948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:38.421465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:38.422277 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:38.422765 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:38.800772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:38.801478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:38.809842 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:38.810589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:38.811447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:38.811948 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:38.851218 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:38.863447 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-528c0497-e56d-49d9-8f52-7650140da6ae tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1317 microversion: 2.1 time: 0.462564 Sep 15 08:58:38.866134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 80/148] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:38 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:38.966849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:38.967924 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:38.974771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:38.975403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:38.976318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:38.976685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:39.152530 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:39.170967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-164c4256-e979-44c6-be6d-35f21989a0aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.380552 Sep 15 08:58:39.171506 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 69/149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:38 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:39.203093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:39.203731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:39.217352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:39.218184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:39.219102 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:39.219693 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:39.531823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:39.554299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5a5f2c00-92a5-42a2-b34a-0994fd057c4e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.601191 Sep 15 08:58:39.559693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 81/150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:38 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:39.594438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:39.594826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:39.595215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:39.603306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:39.604156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:39.604983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:39.605558 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:39.606931 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d325e475-1a4d-4555-b786-92b82c39dc7f tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1502 microversion: 2.1 time: 0.426237 Sep 15 08:58:39.607487 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 70/151] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:39 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1502 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:39.889266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:39.889934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:39.919025 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:39.919665 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:39.920477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:39.920918 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:40.084663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:40.109654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:40.141084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:40.149738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f84ccc49-8133-49d5-8be2-0f22eb3ca02d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.572503 Sep 15 08:58:40.155080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 82/152] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:39 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:40.193657 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:40.196753 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:40.221962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:40.228640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:40.229826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:40.231416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:40.434005 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:40.455111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-57c98085-724c-4502-9ae9-2690640eebfc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1506 microversion: 2.1 time: 0.578704 Sep 15 08:58:40.455869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 71/153] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:39 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:40.580156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:40.580774 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:40.588993 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:40.589741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:40.590816 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:40.591468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:40.604612 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:40.621723 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-729e71ee-e3ce-402b-a381-b7e006bd8105 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.437870 Sep 15 08:58:40.641374 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 83/154] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:40 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:40.660505 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-d93299b0-b26c-4b9d-95cf-aeee3ca43775 req-0afd56b5-2bf8-42d5-b005-76f5dbbb1656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d8f72b-fc30-41ab-922d-6e83c2b253e1", "name": "network-vif-plugged", "status": "completed", "tag": "fd7b9192-1dcd-4cd1-8019-0543a7285ecc"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:40.672284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:40.672284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:58:40.681546 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-d93299b0-b26c-4b9d-95cf-aeee3ca43775 req-0afd56b5-2bf8-42d5-b005-76f5dbbb1656 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:40.681985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-d93299b0-b26c-4b9d-95cf-aeee3ca43775 req-0afd56b5-2bf8-42d5-b005-76f5dbbb1656 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:40.703250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-d93299b0-b26c-4b9d-95cf-aeee3ca43775 req-0afd56b5-2bf8-42d5-b005-76f5dbbb1656 service nova] Creating event network-vif-plugged:fd7b9192-1dcd-4cd1-8019-0543a7285ecc for instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 on hv-cinder-80600 Sep 15 08:58:40.711327 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-d93299b0-b26c-4b9d-95cf-aeee3ca43775 req-0afd56b5-2bf8-42d5-b005-76f5dbbb1656 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072002 Sep 15 08:58:40.712952 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 84/155] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:40.837803 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:40.859977 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a68a86f7-c044-4ffe-a9be-3bed64d28732 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.288646 Sep 15 08:58:40.864339 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 72/156] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:40 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:41.177706 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:41.178422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:41.187554 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:41.188029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:41.188747 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:41.189166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:41.396417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:41.410166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:41.416361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:41.417392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-07cea8ea-cfab-4067-9ff8-d4a43991722d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.249246 Sep 15 08:58:41.417902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 85/157] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:41 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:41.654972 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:41.655568 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:41.663458 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:41.663899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:41.664740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:41.665159 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:41.873752 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:41.882295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-57e953e0-cb93-4393-b51c-e6e9ce968dfe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.237401 Sep 15 08:58:41.882989 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 73/158] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:41 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:41.887811 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:41.888540 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:41.896253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:41.896702 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:41.898123 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:41.898567 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:42.108276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:42.116532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a657cff7-18ee-45f1-ae1a-306d68fb84e3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.239443 Sep 15 08:58:42.117103 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 86/159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:41 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:42.412053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5f7072f2-b5e4-4a41-9625-66e6e1e90c60 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cddf70f4-ae0a-4759-96f9-3ba53262ed8b"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:42.413158 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5f7072f2-b5e4-4a41-9625-66e6e1e90c60 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:42.420888 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f7072f2-b5e4-4a41-9625-66e6e1e90c60 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:42.421328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f7072f2-b5e4-4a41-9625-66e6e1e90c60 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:42.422112 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f7072f2-b5e4-4a41-9625-66e6e1e90c60 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:42.422558 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f7072f2-b5e4-4a41-9625-66e6e1e90c60 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:42.440546 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:42.441148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:42.448393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:42.448826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:42.449579 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:42.449998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:42.649672 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:42.663272 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:42.670135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:42.671174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c04cdd93-0263-4d8c-a145-6ca3f325a771 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.240530 Sep 15 08:58:42.671697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 87/160] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:42 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:42.905276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:42.905880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:42.913107 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:42.913546 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:42.914343 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:42.914819 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:43.120001 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:43.128139 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c282ea95-e4d5-4eb0-8550-a3f33795fa68 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.232697 Sep 15 08:58:43.128654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 88/161] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:42 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:43.139826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:43.140423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:43.147591 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:43.148036 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:43.148792 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:43.149222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:43.349880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:43.357888 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a2a40e82-5e40-424a-a113-3634904e5213 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.228268 Sep 15 08:58:43.358446 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 89/162] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:43 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:43.694598 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:43.695113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:43.702288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:43.702731 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:43.703490 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:43.703911 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:43.914832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:43.928674 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:43.935557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:43.936611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0f9e7119-4f73-4c2a-ad92-f5526ceb11ea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.251245 Sep 15 08:58:43.937131 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 90/163] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:43 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:44.150758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:44.151867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:44.159294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:44.159736 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:44.160515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:44.161053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:44.368699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:44.377202 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d5392431-b330-451f-ae60-b565034ba1ba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.236092 Sep 15 08:58:44.377735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 91/164] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:44 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:44.388938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:44.389538 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:44.396488 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:44.396930 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:44.397693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:44.398139 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:44.610381 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:44.622980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-20a40c0f-b669-47a8-bee1-7df4b5d41c43 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.243865 Sep 15 08:58:44.624404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 92/165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:44 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:44.961078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:44.961678 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:44.969399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:44.969836 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:44.970638 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:44.971062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:45.176508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:45.190404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:45.196731 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:45.197783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e81c3fdb-ff09-4ffb-aa30-e2590b64da4c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.246451 Sep 15 08:58:45.198427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 93/166] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:44 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:45.399134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:45.400064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:45.408224 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:45.408661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:45.409451 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:45.409870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:45.421704 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5f7072f2-b5e4-4a41-9625-66e6e1e90c60 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "POST /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.018747 Sep 15 08:58:45.426286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 74/167] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 08:58:42 2021] POST /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c/os-volume_attachments => generated 194 bytes in 3020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:45.680096 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:45.685094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:45.686747 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:45.691389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-26ff435c-c8f4-4f2a-927c-a44b9eb400ad tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.301594 Sep 15 08:58:45.701187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 94/168] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:45 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:45.725304 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:45.728336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:45.736583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:45.737119 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:45.998297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:46.009307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-810ad6a7-de83-435b-b8dd-15dfeeba9a4a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.371361 Sep 15 08:58:46.022679 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 75/169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:45 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:46.094820 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8c9a8437-643c-4c21-aaad-9c4c7f76378e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37e07dda-b076-4902-ad66-37f9305c9d2b"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:46.096616 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8c9a8437-643c-4c21-aaad-9c4c7f76378e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:46.113080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8c9a8437-643c-4c21-aaad-9c4c7f76378e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:46.113714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8c9a8437-643c-4c21-aaad-9c4c7f76378e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:46.114715 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8c9a8437-643c-4c21-aaad-9c4c7f76378e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:46.115345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8c9a8437-643c-4c21-aaad-9c4c7f76378e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:46.221751 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:46.222518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:46.232077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:46.232549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:46.233312 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:46.233753 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:46.443802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:46.457559 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:46.464306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:46.465359 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a7fcc255-53ba-454a-9b52-e3095c61252e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.254011 Sep 15 08:58:46.465875 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 76/170] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:46 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:46.712556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:46.713050 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:46.720205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:46.720646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:46.723842 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:46.723842 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:46.926945 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:46.935689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-63fcf731-2a26-42ba-a72d-9c5d5b90b8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.232335 Sep 15 08:58:46.936231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 77/171] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:46 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:47.016975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8c9a8437-643c-4c21-aaad-9c4c7f76378e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932209 Sep 15 08:58:47.017558 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 95/172] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 08:58:46 2021] POST /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments => generated 194 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:58:47.032285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:47.033309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:47.041809 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:47.042280 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:47.043083 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:47.043511 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:47.263183 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:47.271432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fd252f1b-b422-40d4-8e78-f7704c4cdd80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.249076 Sep 15 08:58:47.271961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 78/173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:47 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:47.490352 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:47.491470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:47.500072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:47.500620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:47.501535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:47.502055 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:47.704095 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:47.717679 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:47.723894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:47.724925 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6a794ce5-dcb1-4f03-880a-5a0ac3306fc7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.244756 Sep 15 08:58:47.725484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 96/174] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:47 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:47.958818 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:47.964514 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:47.967780 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:47.968230 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:47.968998 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:47.969425 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:48.177058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:48.186117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3712ec15-81e6-4f10-84de-a72abff505ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.236614 Sep 15 08:58:48.186686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 79/175] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:47 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:48.293408 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:48.294005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:48.301779 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:48.310601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:48.310601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:48.310601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:48.523163 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:48.531506 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e13917da-fb75-45e9-bd5e-effe9adf31d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.247431 Sep 15 08:58:48.532031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 97/176] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:48 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:48.749538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:48.750161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:48.757330 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:48.757782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:48.758620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:48.759035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:48.971534 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:48.992471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:49.001814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:49.004118 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7b9bef62-e68c-4477-82ee-0a79b4158b74 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.263718 Sep 15 08:58:49.004432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 80/177] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:48 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:49.208371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:49.208972 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:49.217032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:49.217472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:49.218264 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:49.218691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:49.261190 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-3f8992ef-7fc7-44cd-a2fe-639d1bd951b5 req-90443fe9-1a24-47e5-b88a-fa6bde357cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661af67d-f3ef-4c65-bcb6-a51b229ddbf0", "name": "network-vif-plugged", "status": "completed", "tag": "afdabbd5-43b9-4136-8495-2bdae211bde3"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:49.267813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:49.267813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:58:49.280565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-3f8992ef-7fc7-44cd-a2fe-639d1bd951b5 req-90443fe9-1a24-47e5-b88a-fa6bde357cc7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:49.281358 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-3f8992ef-7fc7-44cd-a2fe-639d1bd951b5 req-90443fe9-1a24-47e5-b88a-fa6bde357cc7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:49.300721 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-3f8992ef-7fc7-44cd-a2fe-639d1bd951b5 req-90443fe9-1a24-47e5-b88a-fa6bde357cc7 service nova] Creating event network-vif-plugged:afdabbd5-43b9-4136-8495-2bdae211bde3 for instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 on hv-cinder-80600 Sep 15 08:58:49.306463 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-3f8992ef-7fc7-44cd-a2fe-639d1bd951b5 req-90443fe9-1a24-47e5-b88a-fa6bde357cc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058846 Sep 15 08:58:49.310000 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 81/178] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:49.443118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:49.453987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c7b4f97b-671e-44f8-be60-b92223b21df2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.254781 Sep 15 08:58:49.463258 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 98/179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:49 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:49.554610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:49.555298 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:49.562692 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:49.563132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:49.563985 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:49.564355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:49.921052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:49.929838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ca90ef04-dccc-489a-8269-484eafc55742 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.384686 Sep 15 08:58:49.934785 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 82/180] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:49 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:50.025734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:50.026363 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:50.034227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:50.035623 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:50.035623 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:50.036018 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:50.300742 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:50.315303 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:50.321560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:50.322762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-70a8fbc0-90b8-4c14-9729-0a4dda09643f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.306099 Sep 15 08:58:50.323283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 99/181] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:50 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:50.477361 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:50.479427 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:50.487688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:50.488226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:50.489200 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:50.489632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:50.705217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:50.713758 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8091583e-cdc3-4602-8ba8-973d5ae240be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.245996 Sep 15 08:58:50.714299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 83/182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:50 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:50.952660 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:50.953256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:50.965296 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:50.966030 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:50.967161 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:50.967587 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:51.174296 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:51.183044 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-81d88e4d-41e3-4744-afa7-300a63c45db1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.240052 Sep 15 08:58:51.183568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 100/183] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:50 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:51.331569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-afb466a9-c96d-4cdd-a022-b8f5571bfb70 req-54bd7ff0-92ef-490b-a2be-4cf187ad047d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc1c15f-24f5-496f-a675-9771d0025292", "name": "network-vif-plugged", "status": "completed", "tag": "834d7008-fc0a-404f-8253-016e3f7d8ca2"}, {"server_uuid": "5ba14ca7-eb88-437e-9c49-5101925f639b", "name": "network-vif-plugged", "status": "completed", "tag": "314b817f-9c79-46cf-a672-a625eea4af10"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:51.338697 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:58:51.338697 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:58:51.347520 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:51.348276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:51.349187 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-afb466a9-c96d-4cdd-a022-b8f5571bfb70 req-54bd7ff0-92ef-490b-a2be-4cf187ad047d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:51.349786 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-afb466a9-c96d-4cdd-a022-b8f5571bfb70 req-54bd7ff0-92ef-490b-a2be-4cf187ad047d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:51.356704 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:51.357148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:51.357912 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:51.358620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:51.371949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-afb466a9-c96d-4cdd-a022-b8f5571bfb70 req-54bd7ff0-92ef-490b-a2be-4cf187ad047d service nova] Creating event network-vif-plugged:834d7008-fc0a-404f-8253-016e3f7d8ca2 for instance 9bc1c15f-24f5-496f-a675-9771d0025292 on hv-cinder-80600 Sep 15 08:58:51.372375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-afb466a9-c96d-4cdd-a022-b8f5571bfb70 req-54bd7ff0-92ef-490b-a2be-4cf187ad047d service nova] Creating event network-vif-plugged:314b817f-9c79-46cf-a672-a625eea4af10 for instance 5ba14ca7-eb88-437e-9c49-5101925f639b on hv-cinder-80600 Sep 15 08:58:51.386917 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-afb466a9-c96d-4cdd-a022-b8f5571bfb70 req-54bd7ff0-92ef-490b-a2be-4cf187ad047d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065988 Sep 15 08:58:51.387482 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 84/184] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:58:51 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:58:51.592233 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:51.607316 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:51.614130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:51.615327 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b803deab-c8e5-4da6-ab39-132375eda6cd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.278387 Sep 15 08:58:51.616080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 101/185] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:51 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:51.737415 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:51.738191 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:51.746919 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:51.747366 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:51.752526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:51.752526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:51.958799 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:51.968047 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b7cb9482-a55a-483f-a861-d1d367a958ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.241275 Sep 15 08:58:51.973549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 85/186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:51 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:52.206905 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:52.207602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:52.217106 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:52.217634 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:52.231348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:52.232074 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:52.643243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:52.643450 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:52.643953 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:52.666740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:52.678784 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:52.679616 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0273783a-2bc2-46a4-a7a9-cc58b21439e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.482556 Sep 15 08:58:52.680426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 102/187] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:52 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:52.690309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:52.691655 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:52.950543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:52.964851 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:52.971538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:52.972773 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-34f012c4-b17a-4f50-a775-133dffabdb6e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.342318 Sep 15 08:58:52.985352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 86/188] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:52 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:53.000025 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:53.001065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:53.011368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:53.012008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:53.013153 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:53.014749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:53.229799 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:53.237893 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0e20173f-5852-485c-9e99-8a7aba554944 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.253131 Sep 15 08:58:53.238515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 103/189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:52 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:53.701699 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:53.702538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:53.710384 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:53.711095 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:53.712057 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:53.712813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:53.997759 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:53.999935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:54.000658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:54.007167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-be658568-2f36-43a0-bf65-62f9c065f543 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.314340 Sep 15 08:58:54.007987 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 87/190] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:53 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:54.016658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:54.017532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:54.022017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:54.022017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:54.236979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:54.260789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:54.261006 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:54.268193 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:54.268892 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:54.269561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:54.270037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dd10dae3-7695-42ae-ad31-7512d15d88d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.281256 Sep 15 08:58:54.270288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:54.271546 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:54.271858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 104/191] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:53 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 08:58:54.271969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:54.520075 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:54.528109 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5ccac6d4-13ca-45c8-8c17-c46c24e6a54b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1362 microversion: 2.1 time: 0.277160 Sep 15 08:58:54.528634 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 88/192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:54 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:55.031211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:55.032940 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:55.043918 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.044664 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.045635 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.046411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.303414 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:55.304014 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:55.313477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.314002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.314956 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.315660 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.367520 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:55.376341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f9faad55-ec82-412d-8182-505e9a695c80 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1322 microversion: 2.1 time: 0.355807 Sep 15 08:58:55.376852 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 105/193] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:55 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:55.554238 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:55.554838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:55.570553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.570553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.570553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.570553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.580441 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:55.606217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:55.618039 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:55.621272 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-33137da5-496f-426f-8cdf-d4f70047f360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1407 microversion: 2.20 time: 0.331805 Sep 15 08:58:55.621272 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 89/194] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:55 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:55.792087 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:55.802350 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0ada86b1-f778-47f2-9b7f-ae580a1c72e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1549 microversion: 2.1 time: 0.257641 Sep 15 08:58:55.802960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 106/195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:55 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1549 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:58:55.827124 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6274880d-2b4b-490d-86e5-5918c0542ce3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:55.827599 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6274880d-2b4b-490d-86e5-5918c0542ce3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:55.835447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6274880d-2b4b-490d-86e5-5918c0542ce3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.835893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6274880d-2b4b-490d-86e5-5918c0542ce3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.836671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6274880d-2b4b-490d-86e5-5918c0542ce3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:55.837102 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6274880d-2b4b-490d-86e5-5918c0542ce3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:55.990256 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6274880d-2b4b-490d-86e5-5918c0542ce3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174191 Sep 15 08:58:55.991076 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 90/196] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Sep 15 08:58:55 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:58:56.398204 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:56.398810 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:56.406732 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:56.407180 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:56.407946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:56.408384 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:56.624491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:56.636049 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fcb5e6f0-6c6c-4b9f-902f-47fd80e2e6ea tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1516 microversion: 2.1 time: 0.247100 Sep 15 08:58:56.637150 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 107/197] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:56 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1516 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:56.644096 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:56.644700 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:56.658895 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:56.659373 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:56.660145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:56.660565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:56.662701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:58:56.664370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:56.676763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:56.677494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:56.678921 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:56.679640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:56.762451 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'flavor' on Instance uuid 9bc1c15f-24f5-496f-a675-9771d0025292 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 08:58:57.036580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:57.050843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:57.057627 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:57.058995 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-20e1c81b-2549-4e6e-b771-7145bc38db94 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1598 microversion: 2.20 time: 0.425358 Sep 15 08:58:57.059507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 91/198] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 08:58:56 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1598 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 08:58:57.082823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1f5f29d3-c33d-4e19-a09e-049a4fe4b4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:57.083310 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1f5f29d3-c33d-4e19-a09e-049a4fe4b4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:57.090457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f5f29d3-c33d-4e19-a09e-049a4fe4b4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:57.090899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f5f29d3-c33d-4e19-a09e-049a4fe4b4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:57.091666 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f5f29d3-c33d-4e19-a09e-049a4fe4b4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:57.092093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f5f29d3-c33d-4e19-a09e-049a4fe4b4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:57.159698 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6f96a88f-4380-4755-9e6b-40a5e982869f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292/action" status: 200 len: 32 microversion: 2.1 time: 0.504806 Sep 15 08:58:57.159698 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 108/199] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:58:56 2021] POST /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292/action => generated 32 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:58:57.176868 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:57.182447 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:57.187391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:57.187928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:57.188743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:57.189213 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:57.349377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1f5f29d3-c33d-4e19-a09e-049a4fe4b4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.275472 Sep 15 08:58:57.357000 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 92/200] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Sep 15 08:58:57 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:58:57.477356 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:57.488433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-237180b5-c238-4989-8e28-408b27174bc5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.327018 Sep 15 08:58:57.489694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 109/201] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:57 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:58.523111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:58.524512 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:58.535825 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:58.536439 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:58.537771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:58.538587 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:58.565204 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:58.566433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:58.576093 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:58.576093 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:58.576791 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:58.577431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:58.652129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 08:58:59.012864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-48af9cec-3cc8-4c5d-b1ee-c4b420e81e63 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 204 len: 0 microversion: 2.1 time: 0.457842 Sep 15 08:58:59.013427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 110/202] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 08:58:58 2021] DELETE /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 08:58:59.037697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:58:59.041298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:58:59.049838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:59.050322 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:59.051215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:58:59.051641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:58:59.365069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:59.393609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-650cb9f2-03e6-4ffc-bb00-69b0d7160b80 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1554 microversion: 2.1 time: 0.356973 Sep 15 08:58:59.393609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 111/203] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:59 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1554 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:58:59.460352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:58:59.472299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-15f04352-5e47-45d6-95d2-923e5b723477 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.968349 Sep 15 08:58:59.473326 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 93/204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:58:58 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:00.209103 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-08cacd32-0665-4737-a1f7-0a7d5545ebf4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:00.209103 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-08cacd32-0665-4737-a1f7-0a7d5545ebf4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:00.211664 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08cacd32-0665-4737-a1f7-0a7d5545ebf4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:00.212212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08cacd32-0665-4737-a1f7-0a7d5545ebf4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:00.213110 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08cacd32-0665-4737-a1f7-0a7d5545ebf4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:00.213640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-08cacd32-0665-4737-a1f7-0a7d5545ebf4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:00.230156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-0c5fcaea-9ea8-4452-a0d8-02dcb5e8ecb1 req-33813ec1-0f64-4d4f-8573-4ba308545560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661af67d-f3ef-4c65-bcb6-a51b229ddbf0", "tag": "afdabbd5-43b9-4136-8495-2bdae211bde3"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:00.255932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:00.255932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:59:00.284021 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-0c5fcaea-9ea8-4452-a0d8-02dcb5e8ecb1 req-33813ec1-0f64-4d4f-8573-4ba308545560 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:00.284466 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-0c5fcaea-9ea8-4452-a0d8-02dcb5e8ecb1 req-33813ec1-0f64-4d4f-8573-4ba308545560 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:00.333578 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-0c5fcaea-9ea8-4452-a0d8-02dcb5e8ecb1 req-33813ec1-0f64-4d4f-8573-4ba308545560 service nova] Creating event network-changed:afdabbd5-43b9-4136-8495-2bdae211bde3 for instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 on hv-cinder-80600 Sep 15 08:59:00.345652 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-0c5fcaea-9ea8-4452-a0d8-02dcb5e8ecb1 req-33813ec1-0f64-4d4f-8573-4ba308545560 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147890 Sep 15 08:59:00.347837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 94/205] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:00.409653 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:00.410373 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:00.429589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:00.430044 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:00.430845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:00.431275 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:00.442362 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-08cacd32-0665-4737-a1f7-0a7d5545ebf4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.249354 Sep 15 08:59:00.443466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 112/206] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:00 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:00.497050 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:00.497735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:00.527182 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:00.545654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:00.547854 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:00.558748 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:00.993231 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:01.008129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c0955db7-26c5-479e-968c-69717cb99b84 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.523099 Sep 15 08:59:01.008684 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 113/207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:00 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:01.462552 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-50113b46-f06f-4193-a90f-3da3738e6024 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:01.466356 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-50113b46-f06f-4193-a90f-3da3738e6024 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:01.484210 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-50113b46-f06f-4193-a90f-3da3738e6024 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:01.484680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-50113b46-f06f-4193-a90f-3da3738e6024 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:01.485517 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-50113b46-f06f-4193-a90f-3da3738e6024 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:01.486008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-50113b46-f06f-4193-a90f-3da3738e6024 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:01.509376 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:01.523130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4c5d73f8-db99-483e-873d-7805ede30d69 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1554 microversion: 2.1 time: 1.123016 Sep 15 08:59:01.535077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 95/208] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:00 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1554 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:01.550411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-74b02157-bf33-46ea-9004-1b9d25137bef tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:01.551387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-74b02157-bf33-46ea-9004-1b9d25137bef tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:01.566630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74b02157-bf33-46ea-9004-1b9d25137bef tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:01.566630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74b02157-bf33-46ea-9004-1b9d25137bef tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:01.566630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74b02157-bf33-46ea-9004-1b9d25137bef tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:01.566630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74b02157-bf33-46ea-9004-1b9d25137bef tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:01.832385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-50113b46-f06f-4193-a90f-3da3738e6024 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.382600 Sep 15 08:59:01.853333 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 114/209] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:01 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:59:01.853484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-74b02157-bf33-46ea-9004-1b9d25137bef tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.314790 Sep 15 08:59:01.853484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 96/210] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:01 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:02.031288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:02.031993 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:02.040502 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:02.041556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:02.042558 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:02.043104 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:02.346917 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:02.362745 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c5cf028b-db31-4f9b-842a-5b589379403a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.340291 Sep 15 08:59:02.362745 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 115/211] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:02 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:02.375826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-864349b1-9563-4410-b142-19717ba273a0 req-f2adefdb-1371-422b-8a71-1211de866988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba14ca7-eb88-437e-9c49-5101925f639b", "tag": "314b817f-9c79-46cf-a672-a625eea4af10"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:02.408022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:02.408022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:59:02.428708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-864349b1-9563-4410-b142-19717ba273a0 req-f2adefdb-1371-422b-8a71-1211de866988 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:02.431297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-864349b1-9563-4410-b142-19717ba273a0 req-f2adefdb-1371-422b-8a71-1211de866988 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:02.475651 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-864349b1-9563-4410-b142-19717ba273a0 req-f2adefdb-1371-422b-8a71-1211de866988 service nova] Creating event network-changed:314b817f-9c79-46cf-a672-a625eea4af10 for instance 5ba14ca7-eb88-437e-9c49-5101925f639b on hv-cinder-80600 Sep 15 08:59:02.488986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-864349b1-9563-4410-b142-19717ba273a0 req-f2adefdb-1371-422b-8a71-1211de866988 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118807 Sep 15 08:59:02.488986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 97/212] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:59:02.549389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:02.550004 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:02.585405 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:02.585847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:02.586937 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:02.587514 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:02.865814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1c4dd9d4-aba1-4bac-a8c1-2f4f2667026c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:02.867121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1c4dd9d4-aba1-4bac-a8c1-2f4f2667026c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:02.884424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1c4dd9d4-aba1-4bac-a8c1-2f4f2667026c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:02.887082 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1c4dd9d4-aba1-4bac-a8c1-2f4f2667026c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:02.887886 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1c4dd9d4-aba1-4bac-a8c1-2f4f2667026c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:02.888321 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1c4dd9d4-aba1-4bac-a8c1-2f4f2667026c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:03.062681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1c4dd9d4-aba1-4bac-a8c1-2f4f2667026c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.210677 Sep 15 08:59:03.066726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 98/213] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:02 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:03.100557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-12f71d03-fb0b-4fc7-9c9f-91832fa6bba9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:03.101493 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-12f71d03-fb0b-4fc7-9c9f-91832fa6bba9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:03.109540 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12f71d03-fb0b-4fc7-9c9f-91832fa6bba9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:03.120992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12f71d03-fb0b-4fc7-9c9f-91832fa6bba9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:03.120992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12f71d03-fb0b-4fc7-9c9f-91832fa6bba9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:03.120992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-12f71d03-fb0b-4fc7-9c9f-91832fa6bba9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:03.286446 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:03.310241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-51e3f8b7-91a5-4c19-8327-7c4349c435b1 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1554 microversion: 2.1 time: 0.773157 Sep 15 08:59:03.312073 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 116/214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:02 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1554 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:03.350126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-12f71d03-fb0b-4fc7-9c9f-91832fa6bba9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.281747 Sep 15 08:59:03.353667 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 99/215] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:03 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:03.389835 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:03.390568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:03.401427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:03.414694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:03.414694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:03.414694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:03.773662 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:03.781812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7fd3ebf5-9d7e-49a4-a82d-7835015ce5bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.406647 Sep 15 08:59:03.782455 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 117/216] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:03 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:04.079583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-02324f6f-85a3-4e40-b218-1be39d4257ff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:04.080577 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-02324f6f-85a3-4e40-b218-1be39d4257ff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:04.088995 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02324f6f-85a3-4e40-b218-1be39d4257ff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.089751 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02324f6f-85a3-4e40-b218-1be39d4257ff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.090780 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02324f6f-85a3-4e40-b218-1be39d4257ff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.091356 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02324f6f-85a3-4e40-b218-1be39d4257ff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.248598 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-02324f6f-85a3-4e40-b218-1be39d4257ff tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.178266 Sep 15 08:59:04.249237 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 100/217] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:04 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:04.332862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:04.333847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:04.345760 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.346574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.347564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.348181 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.370741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2ee7cfe8-0ea7-42c7-b26b-693a4d35e129 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:04.372184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2ee7cfe8-0ea7-42c7-b26b-693a4d35e129 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:04.383448 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ee7cfe8-0ea7-42c7-b26b-693a4d35e129 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.387375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ee7cfe8-0ea7-42c7-b26b-693a4d35e129 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.387375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ee7cfe8-0ea7-42c7-b26b-693a4d35e129 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.387375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ee7cfe8-0ea7-42c7-b26b-693a4d35e129 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.522234 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:04.542124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-abc79388-1d9f-4deb-adaf-4b134b8cb556 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1346 microversion: 2.1 time: 0.218453 Sep 15 08:59:04.557234 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 118/218] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:04 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1346 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:04.557507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2ee7cfe8-0ea7-42c7-b26b-693a4d35e129 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.197712 Sep 15 08:59:04.557507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 101/219] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:04 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:04.647559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-11b7ff64-0a27-4c24-bbb7-83a47928aa52 req-9be43519-ed48-4328-af5b-6b99e6ffb0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e110435-269e-4721-b7e3-37454d25489c", "name": "network-vif-deleted", "tag": "3cba594d-903b-492b-a4d0-9d8c4dfb821f"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:04.663462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:04.663462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:59:04.676348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-11b7ff64-0a27-4c24-bbb7-83a47928aa52 req-9be43519-ed48-4328-af5b-6b99e6ffb0f0 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.676348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-11b7ff64-0a27-4c24-bbb7-83a47928aa52 req-9be43519-ed48-4328-af5b-6b99e6ffb0f0 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.714661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-11b7ff64-0a27-4c24-bbb7-83a47928aa52 req-9be43519-ed48-4328-af5b-6b99e6ffb0f0 service nova] Creating event network-vif-deleted:3cba594d-903b-492b-a4d0-9d8c4dfb821f for instance 4e110435-269e-4721-b7e3-37454d25489c on hv-cinder-80600 Sep 15 08:59:04.735334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-11b7ff64-0a27-4c24-bbb7-83a47928aa52 req-9be43519-ed48-4328-af5b-6b99e6ffb0f0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119370 Sep 15 08:59:04.736052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 119/220] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:59:04.805778 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:04.807726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:04.816260 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.817258 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:04.818303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:04.818930 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.080526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:05.090690 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2c26414a-a23b-4c2a-aa65-85ad76ce2726 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.295116 Sep 15 08:59:05.091498 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 102/221] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:04 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:05.265686 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d5629d50-1274-4f37-a5c5-83d44804eee5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:05.267342 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d5629d50-1274-4f37-a5c5-83d44804eee5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:05.275244 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5629d50-1274-4f37-a5c5-83d44804eee5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:05.275673 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5629d50-1274-4f37-a5c5-83d44804eee5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.276434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5629d50-1274-4f37-a5c5-83d44804eee5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:05.276862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d5629d50-1274-4f37-a5c5-83d44804eee5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.438441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d5629d50-1274-4f37-a5c5-83d44804eee5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.183162 Sep 15 08:59:05.439071 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 120/222] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:05 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:05.564443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:05.569299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:05.572368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a11198a9-d1d0-4288-8266-623aafd2d507 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:05.573550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a11198a9-d1d0-4288-8266-623aafd2d507 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:05.574253 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:05.574888 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.575932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:05.576562 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.582268 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a11198a9-d1d0-4288-8266-623aafd2d507 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:05.582718 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a11198a9-d1d0-4288-8266-623aafd2d507 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.583489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a11198a9-d1d0-4288-8266-623aafd2d507 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:05.583915 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a11198a9-d1d0-4288-8266-623aafd2d507 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.667198 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:05.668332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:05.668795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lazy-loading 'fault' on Instance uuid 4e110435-269e-4721-b7e3-37454d25489c {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 08:59:05.772790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a11198a9-d1d0-4288-8266-623aafd2d507 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.210555 Sep 15 08:59:05.773413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 121/223] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:05 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:05.810526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fa2d6a67774d9bbd7b80786bb0d74b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79788e6decc74ae4b1d9bd92aa35a8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:05.831657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-74519a97-2e4f-406f-8782-6398a76545ed tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 200 len: 1351 microversion: 2.1 time: 0.274766 Sep 15 08:59:05.833310 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 103/224] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:05 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 1351 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:06.144428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:06.146538 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:06.158355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.159199 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:06.160382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.161186 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:06.265135 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1138195298", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "1c409703-0674-4cbb-9f3e-f398f357604d"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:06.377185 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] validate_networks() for [('1c409703-0674-4cbb-9f3e-f398f357604d', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:59:06.404685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:06.413204 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-18359b35-f1ae-4b4d-8298-287ce2f82cf5 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.309141 Sep 15 08:59:06.417480 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 122/225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:06 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:06.455067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-18995c3a-6297-49c6-8354-8e377fd50c87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:06.455989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-18995c3a-6297-49c6-8354-8e377fd50c87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:06.463482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18995c3a-6297-49c6-8354-8e377fd50c87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.463857 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18995c3a-6297-49c6-8354-8e377fd50c87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:06.464737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18995c3a-6297-49c6-8354-8e377fd50c87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.465162 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-18995c3a-6297-49c6-8354-8e377fd50c87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:06.635417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-18995c3a-6297-49c6-8354-8e377fd50c87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.190227 Sep 15 08:59:06.638560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 123/226] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:06 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:59:06.792429 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b392eb96-14fc-4f9f-8698-946ebc00a6fa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:06.793449 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b392eb96-14fc-4f9f-8698-946ebc00a6fa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:06.803424 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b392eb96-14fc-4f9f-8698-946ebc00a6fa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.803895 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b392eb96-14fc-4f9f-8698-946ebc00a6fa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:06.804801 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b392eb96-14fc-4f9f-8698-946ebc00a6fa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.805102 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b392eb96-14fc-4f9f-8698-946ebc00a6fa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:06.956344 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b392eb96-14fc-4f9f-8698-946ebc00a6fa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.175249 Sep 15 08:59:06.957266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 124/227] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:06 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:06.968888 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:06.969588 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:06.983942 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.994711 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:06.994711 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:06.994711 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.046990 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] HTTP exception thrown: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. Sep 15 08:59:07.047594 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Returning 404 to user: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:07.048429 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d3a37487-0a8d-42c3-af64-7151ad9a6580 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 404 len: 111 microversion: 2.1 time: 0.089941 Sep 15 08:59:07.049332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 125/228] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:06 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 08:59:07.235605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:59:07.235605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:59:07.237010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:59:07.238266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:59:07.238704 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:59:07.247508 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.247973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.248945 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.249371 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.274818 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:07.276519 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:07.278487 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:59:07.283297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for user aa9a7f77c7354c099697032b66c9a99a and project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:59:07.289384 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.292507 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.293430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.294386 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.295188 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:59:07.297541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:59:07.359354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] HTTP exception thrown: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. Sep 15 08:59:07.359947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Returning 404 to user: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:07.360831 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-517882c9-eabb-430d-b4c1-4543c5efdf11 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.097757 Sep 15 08:59:07.361391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 126/229] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 08:59:07 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c/os-volume_attachments => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 08:59:07.425768 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-71419088-22d1-4052-9cba-0034ba161ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184496 Sep 15 08:59:07.426658 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 104/230] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:59:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 08:59:07.443054 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:07.450049 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fecb3018-d42d-4c26-aa63-05344bc324b3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:07.450680 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fecb3018-d42d-4c26-aa63-05344bc324b3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:07.454940 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:07.464339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.465008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.466003 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.466690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.561486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fecb3018-d42d-4c26-aa63-05344bc324b3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:07.585711 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fecb3018-d42d-4c26-aa63-05344bc324b3 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1218 microversion: 2.1 time: 0.152701 Sep 15 08:59:07.594984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 105/231] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:07 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:07.657234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9bf2dc0f-c3e9-477c-bdda-35b310621888 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:07.662328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9bf2dc0f-c3e9-477c-bdda-35b310621888 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:07.670740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf2dc0f-c3e9-477c-bdda-35b310621888 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.671997 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf2dc0f-c3e9-477c-bdda-35b310621888 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.673650 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf2dc0f-c3e9-477c-bdda-35b310621888 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.674326 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf2dc0f-c3e9-477c-bdda-35b310621888 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.757870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:07.766889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-653584af-cb2f-4f56-8228-3c76d6ab18df tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.340360 Sep 15 08:59:07.775703 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 127/232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:07 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:07.865726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9bf2dc0f-c3e9-477c-bdda-35b310621888 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.219285 Sep 15 08:59:07.867238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 106/233] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:07 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:07.975789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fb408ab1-98a2-47c7-9453-de7fdd23ce8f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:07.977034 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fb408ab1-98a2-47c7-9453-de7fdd23ce8f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:07.987329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb408ab1-98a2-47c7-9453-de7fdd23ce8f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.987989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb408ab1-98a2-47c7-9453-de7fdd23ce8f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:07.989094 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb408ab1-98a2-47c7-9453-de7fdd23ce8f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:07.989743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb408ab1-98a2-47c7-9453-de7fdd23ce8f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:08.147396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fb408ab1-98a2-47c7-9453-de7fdd23ce8f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.182406 Sep 15 08:59:08.148588 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 128/234] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:07 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:08.613109 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:08.614507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:08.623581 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:08.624024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:08.624801 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:08.625230 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:08.787541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:08.787541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ba282cbd-c8d2-41bc-bef3-ec6458a318e5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1222 microversion: 2.1 time: 0.178827 Sep 15 08:59:08.787541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 107/235] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:08 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:08.788003 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:08.788705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:08.798281 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:08.798727 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:08.799877 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:08.800334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:08.883062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b4b75832-c825-45bb-aa1b-e84c45bc49c7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:08.884145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b4b75832-c825-45bb-aa1b-e84c45bc49c7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:08.892518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4b75832-c825-45bb-aa1b-e84c45bc49c7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:08.893042 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4b75832-c825-45bb-aa1b-e84c45bc49c7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:08.893926 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4b75832-c825-45bb-aa1b-e84c45bc49c7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:08.894449 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4b75832-c825-45bb-aa1b-e84c45bc49c7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.029606 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b4b75832-c825-45bb-aa1b-e84c45bc49c7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.155692 Sep 15 08:59:09.030261 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 108/236] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:08 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 08:59:09.041301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:09.041822 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:09.060210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.066614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.066614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.066614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.066910 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:09.076896 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-aef04605-a53f-4948-908f-48c570e46941 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.298348 Sep 15 08:59:09.078299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 129/237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:08 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:09.158055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] HTTP exception thrown: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. Sep 15 08:59:09.158851 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Returning 404 to user: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:09.159978 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1a7dc0f7-9650-4c17-bdd2-b8ae6c5a4978 tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 404 len: 111 microversion: 2.1 time: 0.128509 Sep 15 08:59:09.160994 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 109/238] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 08:59:09 2021] DELETE /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 08:59:09.166720 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d1ad001e-2421-46d1-bb8f-61e81557a991 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:09.169300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d1ad001e-2421-46d1-bb8f-61e81557a991 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:09.175853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:09.176660 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] [instance: 4e110435-269e-4721-b7e3-37454d25489c] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:09.184674 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d1ad001e-2421-46d1-bb8f-61e81557a991 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.185869 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d1ad001e-2421-46d1-bb8f-61e81557a991 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.186621 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.187076 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.187858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.188466 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.189676 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d1ad001e-2421-46d1-bb8f-61e81557a991 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.190319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d1ad001e-2421-46d1-bb8f-61e81557a991 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.289614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] HTTP exception thrown: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. Sep 15 08:59:09.290241 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] Returning 404 to user: Instance 4e110435-269e-4721-b7e3-37454d25489c could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:09.291237 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e75b909e-dcc0-4119-a270-cd1d47affdbd tempest-DeleteServersTestJSON-158581639 tempest-DeleteServersTestJSON-158581639-project] 10.222.0.39 "GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c" status: 404 len: 111 microversion: 2.1 time: 0.126501 Sep 15 08:59:09.292209 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 110/239] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:09 2021] GET /compute/v2.1/servers/4e110435-269e-4721-b7e3-37454d25489c => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 08:59:09.370862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d1ad001e-2421-46d1-bb8f-61e81557a991 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.216376 Sep 15 08:59:09.371758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 130/240] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:09 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:09.812789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:09.813392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:09.834257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.834257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:09.834257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:09.834257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:10.001407 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:10.018933 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c6e03598-0f01-4801-871d-a9d8823b448f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1270 microversion: 2.1 time: 0.216608 Sep 15 08:59:10.019477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 111/241] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:09 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:10.059534 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6eb7c0e4-b9c0-4ba8-a088-57a0aa8aa0bb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:10.060547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6eb7c0e4-b9c0-4ba8-a088-57a0aa8aa0bb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:10.081391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb7c0e4-b9c0-4ba8-a088-57a0aa8aa0bb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:10.084957 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb7c0e4-b9c0-4ba8-a088-57a0aa8aa0bb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:10.088948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb7c0e4-b9c0-4ba8-a088-57a0aa8aa0bb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:10.089553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb7c0e4-b9c0-4ba8-a088-57a0aa8aa0bb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:10.100019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:10.106054 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:10.126463 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:10.130621 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:10.131596 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:10.133094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:10.304445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6eb7c0e4-b9c0-4ba8-a088-57a0aa8aa0bb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.262120 Sep 15 08:59:10.305083 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 131/242] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:10 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:10.398363 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-94800d33-f177-47d1-9157-44c3c0a8424f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:10.402189 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-94800d33-f177-47d1-9157-44c3c0a8424f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:10.422188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-94800d33-f177-47d1-9157-44c3c0a8424f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:10.422847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-94800d33-f177-47d1-9157-44c3c0a8424f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:10.423452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-94800d33-f177-47d1-9157-44c3c0a8424f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:10.423885 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-94800d33-f177-47d1-9157-44c3c0a8424f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:10.556005 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:10.568165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-db195d2c-d97d-4103-b48c-a10c3429743c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.477278 Sep 15 08:59:10.568730 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 112/243] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:10 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:10.600240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-94800d33-f177-47d1-9157-44c3c0a8424f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.220844 Sep 15 08:59:10.602679 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 132/244] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:10 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:11.041781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:11.046961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:11.049718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.049884 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.050674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.051097 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.271458 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:11.280072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2478a5de-6f25-46f2-8b94-07656aa1f995 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1276 microversion: 2.1 time: 0.247787 Sep 15 08:59:11.291045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 113/245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:11 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:11.321535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8ef6fbd3-e36b-4adb-b3a6-98f6ccebe966 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:11.322630 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8ef6fbd3-e36b-4adb-b3a6-98f6ccebe966 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:11.330758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd3-e36b-4adb-b3a6-98f6ccebe966 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.331416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd3-e36b-4adb-b3a6-98f6ccebe966 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.332185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd3-e36b-4adb-b3a6-98f6ccebe966 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.332786 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd3-e36b-4adb-b3a6-98f6ccebe966 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.502322 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8ef6fbd3-e36b-4adb-b3a6-98f6ccebe966 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.190511 Sep 15 08:59:11.502931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 133/246] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:11 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:11.617951 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a47c647f-d95e-4d6e-936c-c1a2bd6cc61c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:11.618966 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:11.619844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:11.625867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a47c647f-d95e-4d6e-936c-c1a2bd6cc61c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:11.633072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.633519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.634364 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.634965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.636399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a47c647f-d95e-4d6e-936c-c1a2bd6cc61c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.636841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a47c647f-d95e-4d6e-936c-c1a2bd6cc61c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.637787 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a47c647f-d95e-4d6e-936c-c1a2bd6cc61c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:11.638388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a47c647f-d95e-4d6e-936c-c1a2bd6cc61c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:11.816004 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a47c647f-d95e-4d6e-936c-c1a2bd6cc61c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.208212 Sep 15 08:59:11.820094 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 134/247] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:11 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:12.270275 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:12.279553 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1fe5286f-45c7-4bd9-8846-e4652e529d40 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.697473 Sep 15 08:59:12.281688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 114/248] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:11 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:12.309861 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:12.311081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:12.325672 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:12.326820 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:12.327773 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:12.328907 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:12.532165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9183fa85-10b3-41c7-87b6-bd54b6eb22d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:12.551165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9183fa85-10b3-41c7-87b6-bd54b6eb22d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:12.587637 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9183fa85-10b3-41c7-87b6-bd54b6eb22d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:12.588091 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9183fa85-10b3-41c7-87b6-bd54b6eb22d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:12.591785 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9183fa85-10b3-41c7-87b6-bd54b6eb22d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:12.592269 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9183fa85-10b3-41c7-87b6-bd54b6eb22d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:12.798341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9183fa85-10b3-41c7-87b6-bd54b6eb22d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14 microversion: 2.1 time: 0.288383 Sep 15 08:59:12.799347 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 115/249] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:12 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:12.834342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c8356408-b39f-4fd9-b067-5e7f4ab97faf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:12.836099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c8356408-b39f-4fd9-b067-5e7f4ab97faf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:12.845289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8356408-b39f-4fd9-b067-5e7f4ab97faf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:12.846919 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8356408-b39f-4fd9-b067-5e7f4ab97faf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:12.848114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8356408-b39f-4fd9-b067-5e7f4ab97faf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:12.848804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8356408-b39f-4fd9-b067-5e7f4ab97faf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:12.975429 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:12.984738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a8b077df-2982-4daa-813f-8f7a4a133bcf tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.687291 Sep 15 08:59:12.985493 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 135/250] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:12 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:13.024106 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c8356408-b39f-4fd9-b067-5e7f4ab97faf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 14 microversion: 2.20 time: 0.200983 Sep 15 08:59:13.025436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 116/251] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:12 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:13.133078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-6d781d69-7f60-461e-b318-c04e07c79270 req-734cc897-68d0-46cf-a96c-9896f3dcfcac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefb9f8f-d4a0-4329-b49e-f884bcf35681", "tag": "7cd7187b-41bd-477b-985e-41fe4e886e86"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:13.148470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:13.148470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:59:13.158614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-6d781d69-7f60-461e-b318-c04e07c79270 req-734cc897-68d0-46cf-a96c-9896f3dcfcac service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:13.159420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-6d781d69-7f60-461e-b318-c04e07c79270 req-734cc897-68d0-46cf-a96c-9896f3dcfcac service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:13.179213 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-6d781d69-7f60-461e-b318-c04e07c79270 req-734cc897-68d0-46cf-a96c-9896f3dcfcac service nova] Creating event network-changed:7cd7187b-41bd-477b-985e-41fe4e886e86 for instance fefb9f8f-d4a0-4329-b49e-f884bcf35681 on hv-cinder-80600 Sep 15 08:59:13.184316 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-6d781d69-7f60-461e-b318-c04e07c79270 req-734cc897-68d0-46cf-a96c-9896f3dcfcac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066268 Sep 15 08:59:13.185524 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 136/252] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:13.309556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:13.310436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:13.324342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:13.324887 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:13.325772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:13.326503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:13.725333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:13.745951 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8e076670-0a8c-4b8e-a696-49e81a50bd83 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.452515 Sep 15 08:59:13.755833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 117/253] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:13 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:13.817799 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9ec5bbc8-5279-4bad-8627-328ca7bff022 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:13.819683 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9ec5bbc8-5279-4bad-8627-328ca7bff022 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:13.829844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ec5bbc8-5279-4bad-8627-328ca7bff022 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:13.830545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ec5bbc8-5279-4bad-8627-328ca7bff022 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:13.831718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ec5bbc8-5279-4bad-8627-328ca7bff022 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:13.832401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ec5bbc8-5279-4bad-8627-328ca7bff022 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:13.897749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-46a4bb53-68d1-4204-a964-5ab29cc208b1 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Action: 'create', calling method: .version_select at 0x7f1ec659c430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1915680110"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:13.997692 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9ec5bbc8-5279-4bad-8627-328ca7bff022 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 6451 microversion: 2.1 time: 0.178757 Sep 15 08:59:13.997692 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 118/254] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:13 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 6451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:14.012336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:14.019195 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:14.047121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:14.047563 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:14.048331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:14.048753 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:14.480771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:14.532324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1d1f967e-860d-4b55-9271-81fe4f36b5d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.531970 Sep 15 08:59:14.535791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 119/255] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:13 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:14.572513 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7bb6c16d-f732-446b-83f6-6e73161ceb1d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:14.575069 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7bb6c16d-f732-446b-83f6-6e73161ceb1d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:14.599120 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bb6c16d-f732-446b-83f6-6e73161ceb1d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:14.600866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bb6c16d-f732-446b-83f6-6e73161ceb1d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:14.601740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bb6c16d-f732-446b-83f6-6e73161ceb1d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:14.604161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7bb6c16d-f732-446b-83f6-6e73161ceb1d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:14.807895 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7bb6c16d-f732-446b-83f6-6e73161ceb1d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 10893 microversion: 2.20 time: 0.268061 Sep 15 08:59:14.808872 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 120/256] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:14 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 10893 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:14.820973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:14.822409 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:14.831469 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:14.832176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:14.833172 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:14.833602 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:15.101280 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-46a4bb53-68d1-4204-a964-5ab29cc208b1 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.428597 Sep 15 08:59:15.101948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 137/257] 10.222.0.39 () {60 vars in 1155 bytes} [Wed Sep 15 08:59:13 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1430 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 15 08:59:15.114791 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-07e462e7-4755-4373-b858-3a4d6efb18d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:15.115898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-07e462e7-4755-4373-b858-3a4d6efb18d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:15.125201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07e462e7-4755-4373-b858-3a4d6efb18d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:15.125742 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07e462e7-4755-4373-b858-3a4d6efb18d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:15.126691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07e462e7-4755-4373-b858-3a4d6efb18d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:15.127501 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07e462e7-4755-4373-b858-3a4d6efb18d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:15.174883 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:15.185080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dc686d56-19bf-4b6e-a094-a7163f0e2811 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.374856 Sep 15 08:59:15.186275 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 121/258] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:14 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:15.196447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-58e2e25d-3eb6-4c7c-a3e6-d1a58842cffd tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6587d30>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:15.301244 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-58e2e25d-3eb6-4c7c-a3e6-d1a58842cffd tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0" status: 200 len: 345 microversion: 2.1 time: 0.113716 Sep 15 08:59:15.306956 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 122/259] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:15 2021] GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:15.343504 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-07e462e7-4755-4373-b858-3a4d6efb18d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 14203 microversion: 2.1 time: 0.239769 Sep 15 08:59:15.344141 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 138/260] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:15 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 14203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:15.558671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:15.559263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:15.567236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:15.567671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:15.568410 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:15.568828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:15.837665 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0a0b183c-0e09-4cfe-9a86-4ac349fbf4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:15.842682 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0a0b183c-0e09-4cfe-9a86-4ac349fbf4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:15.851433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a0b183c-0e09-4cfe-9a86-4ac349fbf4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:15.852089 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a0b183c-0e09-4cfe-9a86-4ac349fbf4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:15.854211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a0b183c-0e09-4cfe-9a86-4ac349fbf4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:15.854211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a0b183c-0e09-4cfe-9a86-4ac349fbf4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:15.931824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:15.939967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f25a7ef7-e4af-45cd-bc9c-b13737cad4be tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.391221 Sep 15 08:59:15.940675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 123/261] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:15 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:16.036782 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0a0b183c-0e09-4cfe-9a86-4ac349fbf4d4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 15064 microversion: 2.20 time: 0.220618 Sep 15 08:59:16.037482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 139/262] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:15 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 15064 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 08:59:16.206505 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:16.207103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:16.214876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:16.215321 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:16.216080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:16.216520 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:16.320434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f55ee50e-2b40-4c82-817c-ae99f1903b9c tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6567040>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:16.422913 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f55ee50e-2b40-4c82-817c-ae99f1903b9c tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0" status: 200 len: 346 microversion: 2.1 time: 0.111983 Sep 15 08:59:16.430259 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 140/263] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:16 2021] GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0 => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:16.451589 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8bb13f42-3794-46dc-a1a8-999c535a181a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:16.453097 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8bb13f42-3794-46dc-a1a8-999c535a181a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:16.466379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8bb13f42-3794-46dc-a1a8-999c535a181a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:16.466916 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8bb13f42-3794-46dc-a1a8-999c535a181a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:16.468841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8bb13f42-3794-46dc-a1a8-999c535a181a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:16.469292 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8bb13f42-3794-46dc-a1a8-999c535a181a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:16.518057 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:16.528622 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b9fa14cd-7eea-460e-977b-5492ad59d3ed tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.330672 Sep 15 08:59:16.529335 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 124/264] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:16 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:16.539646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3202512d-4443-46df-ab88-04a755e57b3b tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Action: 'create', calling method: .version_select at 0x7f1ec68cb550>, body: {"snapshot": {"volume_id": "c62aa1f0-d27a-45b4-92a5-d7eb60397af0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1535368407"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:16.690815 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8bb13f42-3794-46dc-a1a8-999c535a181a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 18083 microversion: 2.1 time: 0.249507 Sep 15 08:59:16.692301 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 141/265] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:16 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 18083 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:16.708594 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1251212227", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "3b211f18-bead-4cfb-916e-940c2837e9c6"}]}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:16.790690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.network.neutron [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] validate_networks() for [('3b211f18-bead-4cfb-916e-940c2837e9c6', None, None, None)] {{(pid=89582) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:59:17.070914 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3202512d-4443-46df-ab88-04a755e57b3b tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.540295 Sep 15 08:59:17.073025 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 125/266] 10.222.0.39 () {60 vars in 1162 bytes} [Wed Sep 15 08:59:16 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:17.086637 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:17.088896 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:17.128504 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:17.132174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:17.133220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:17.134944 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:17.358996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Flavor limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:59:17.358996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Image limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:59:17.358996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Flavor pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:59:17.358996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Image pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:59:17.358996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:59:17.365788 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:17.366886 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:17.368085 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:17.368704 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:17.389678 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Getting quotas for project 3bf945ad7abb4cedb3e57185c376c289. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:59:17.395111 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Getting quotas for user 2d0dc9c4c21c4569860e648e725a6d90 and project 3bf945ad7abb4cedb3e57185c376c289. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:59:17.409133 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Going to run 1 instances... {{(pid=89582) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:59:17.411748 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:59:17.418366 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:17.427316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-560ab261-68ff-4af5-8a6b-32a6e2b7a06f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.353024 Sep 15 08:59:17.437853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 126/267] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:17 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:17.449378 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dd54241a-08a4-46c8-8cab-acd0ca4ddae8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:17.450156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-dd54241a-08a4-46c8-8cab-acd0ca4ddae8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:17.457241 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dd54241a-08a4-46c8-8cab-acd0ca4ddae8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:17.458047 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dd54241a-08a4-46c8-8cab-acd0ca4ddae8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:17.458863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dd54241a-08a4-46c8-8cab-acd0ca4ddae8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:17.459283 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dd54241a-08a4-46c8-8cab-acd0ca4ddae8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:17.537422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-378c6521-7bbc-4409-b987-407a6e37a85a tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843505 Sep 15 08:59:17.541021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 142/268] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:59:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 08:59:17.556709 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d9e74e5b-7ef9-40c7-adff-149466104e9b tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6525280>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:18.253669 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d9e74e5b-7ef9-40c7-adff-149466104e9b tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431" status: 200 len: 287 microversion: 2.1 time: 0.708840 Sep 15 08:59:18.254224 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 143/269] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Sep 15 08:59:17 2021] GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431 => generated 287 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:18.269775 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:18.270493 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:18.282548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:18.283129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:18.284027 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:18.284528 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:18.538880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:18.547210 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7a053797-40a9-4d40-b006-80a56ce27a05 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.291996 Sep 15 08:59:18.547747 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 144/270] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:18 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:18.557788 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ee1fe886-7406-4a39-8fd4-eb5800e74776 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:18.558538 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ee1fe886-7406-4a39-8fd4-eb5800e74776 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:18.634745 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ee1fe886-7406-4a39-8fd4-eb5800e74776 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:18.642698 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ee1fe886-7406-4a39-8fd4-eb5800e74776 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1219 microversion: 2.1 time: 0.093896 Sep 15 08:59:18.643256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 145/271] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:18 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:18.654582 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-38e1fb6b-1e57-44a0-94f1-08914fbf388e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:18.655546 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-38e1fb6b-1e57-44a0-94f1-08914fbf388e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:18.662508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-38e1fb6b-1e57-44a0-94f1-08914fbf388e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:18.662952 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-38e1fb6b-1e57-44a0-94f1-08914fbf388e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:18.663710 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-38e1fb6b-1e57-44a0-94f1-08914fbf388e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:18.664140 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-38e1fb6b-1e57-44a0-94f1-08914fbf388e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:20.342316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dd54241a-08a4-46c8-8cab-acd0ca4ddae8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 20991 microversion: 2.20 time: 2.902824 Sep 15 08:59:20.342869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 127/272] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:17 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 20991 bytes in 2904 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:20.352925 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cf7c7f53-6de6-45da-9209-b5718bcc0707 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6481280>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:20.398419 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cf7c7f53-6de6-45da-9209-b5718bcc0707 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.054343 Sep 15 08:59:20.398974 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 128/273] 10.222.0.39 () {58 vars in 1140 bytes} [Wed Sep 15 08:59:20 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:20.410634 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:20.411338 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:20.419717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:20.420154 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:20.420942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:20.421366 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:20.437677 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-38e1fb6b-1e57-44a0-94f1-08914fbf388e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 22981 microversion: 2.1 time: 1.793183 Sep 15 08:59:20.438552 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 146/274] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:18 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 22981 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:20.450246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:20.450939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:20.458802 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:20.459248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:20.460011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:20.460437 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:20.712885 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:20.721621 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-54ea0054-a04f-4d89-ad7f-68ceb2e1a681 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.281965 Sep 15 08:59:20.722401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 147/275] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:20 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:20.732260 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:20.732867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:20.739969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:20.740509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:20.741535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:20.741962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:20.764985 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:20.773030 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7a2c90dc-056e-4241-bcd2-b717e95ada25 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.373069 Sep 15 08:59:20.773556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 129/276] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:20 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:20.792367 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e9e60c47-8066-476a-8023-e1ff55f07f36 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6929f70>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:20.854032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e9e60c47-8066-476a-8023-e1ff55f07f36 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431" status: 200 len: 287 microversion: 2.1 time: 0.070708 Sep 15 08:59:20.854552 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 130/277] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Sep 15 08:59:20 2021] GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:20.871326 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:20.879624 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-85899fce-8de4-4428-bd6f-22028ff2b940 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1215 microversion: 2.1 time: 0.156445 Sep 15 08:59:20.880234 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 148/278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:20 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:21.359822 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c04f836e-0b1d-4099-aec0-fff0eabe2a3d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:21.360778 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c04f836e-0b1d-4099-aec0-fff0eabe2a3d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:21.369360 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c04f836e-0b1d-4099-aec0-fff0eabe2a3d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:21.369795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c04f836e-0b1d-4099-aec0-fff0eabe2a3d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:21.370617 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c04f836e-0b1d-4099-aec0-fff0eabe2a3d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:21.371038 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c04f836e-0b1d-4099-aec0-fff0eabe2a3d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:21.454314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ee58f81d-d3f4-4bad-96c6-7fbbe5b668f2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:21.455151 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ee58f81d-d3f4-4bad-96c6-7fbbe5b668f2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:21.463222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee58f81d-d3f4-4bad-96c6-7fbbe5b668f2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:21.463664 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee58f81d-d3f4-4bad-96c6-7fbbe5b668f2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:21.464426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee58f81d-d3f4-4bad-96c6-7fbbe5b668f2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:21.464863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee58f81d-d3f4-4bad-96c6-7fbbe5b668f2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:21.551784 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c04f836e-0b1d-4099-aec0-fff0eabe2a3d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 23228 microversion: 2.20 time: 0.201693 Sep 15 08:59:21.552755 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 131/279] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:21 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 23228 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:21.638575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ee58f81d-d3f4-4bad-96c6-7fbbe5b668f2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 23803 microversion: 2.1 time: 0.193194 Sep 15 08:59:21.640556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 149/280] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:21 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 23803 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:59:21.744255 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:21.745288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:21.757346 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:21.758079 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:21.759713 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:21.760358 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:21.790191 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1212136322", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "63e0e726-1b2c-492a-a326-ad06482c3cf5"}]}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:21.869763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.network.neutron [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] validate_networks() for [('63e0e726-1b2c-492a-a326-ad06482c3cf5', None, None, None)] {{(pid=89582) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:59:22.019973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:22.029483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7111cde5-a73b-4840-8adc-7a6c6c68a111 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.295752 Sep 15 08:59:22.030500 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 132/281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:21 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:22.040820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:22.041543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:22.051752 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.054156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.055046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.055581 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.273359 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:22.284276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dbc4f802-febe-440c-a914-aced16a1c0eb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.252564 Sep 15 08:59:22.286233 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 133/282] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:22 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:22.304424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6d57b930-c0ee-42da-83e6-d22973281d65 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec66911f0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:22.347398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6d57b930-c0ee-42da-83e6-d22973281d65 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431" status: 200 len: 288 microversion: 2.1 time: 0.060958 Sep 15 08:59:22.353662 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 134/283] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Sep 15 08:59:22 2021] GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431 => generated 288 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:22.362491 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:22.363091 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:22.372715 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.377143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.377143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.377143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.501969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:22.510385 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b1713c7c-2127-4765-a2fc-dce60fe35296 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1277 microversion: 2.1 time: 0.161405 Sep 15 08:59:22.511410 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 135/284] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:22 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:22.527287 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fcb0b856-b2b9-4e61-8527-c87afb7831c4 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6481d30>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:22.716717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fcb0b856-b2b9-4e61-8527-c87afb7831c4 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431" status: 202 len: 0 microversion: 2.1 time: 0.204284 Sep 15 08:59:22.717466 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 136/285] 10.222.0.39 () {58 vars in 1254 bytes} [Wed Sep 15 08:59:22 2021] DELETE /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:22.728286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c7296a43-a157-4208-9717-1706f22e5739 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:22.729352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c7296a43-a157-4208-9717-1706f22e5739 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:22.737180 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7296a43-a157-4208-9717-1706f22e5739 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.740607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7296a43-a157-4208-9717-1706f22e5739 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.740607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7296a43-a157-4208-9717-1706f22e5739 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.740607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7296a43-a157-4208-9717-1706f22e5739 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.749194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Flavor limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:59:22.749694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Image limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:59:22.750168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Flavor pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:59:22.750580 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Image pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:59:22.750989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:59:22.761170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.766223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.766223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.766223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.787503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Getting quotas for project 8bd1284f0069453d9dc1923926636b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:59:22.796213 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Getting quotas for user 35dc7acffefb4404af415ceaac2283f4 and project 8bd1284f0069453d9dc1923926636b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:59:22.818065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Going to run 1 instances... {{(pid=89582) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:59:22.820520 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:59:22.908394 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c7296a43-a157-4208-9717-1706f22e5739 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 24824 microversion: 2.20 time: 0.189596 Sep 15 08:59:22.909030 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 137/286] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:22 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 24824 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:22.920434 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-798acf72-8c41-44cb-abaf-6ffbe20bf568 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:22.921425 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-798acf72-8c41-44cb-abaf-6ffbe20bf568 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:22.929255 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-798acf72-8c41-44cb-abaf-6ffbe20bf568 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.929731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-798acf72-8c41-44cb-abaf-6ffbe20bf568 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.930645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-798acf72-8c41-44cb-abaf-6ffbe20bf568 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:22.931085 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-798acf72-8c41-44cb-abaf-6ffbe20bf568 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:22.941154 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3a913e6e-de27-4a59-a275-3e11a75da9db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161915 Sep 15 08:59:22.943171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 150/287] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:59:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 08:59:22.981807 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-4db68e13-56a8-4520-8baf-92836129543b req-b1d18f51-54c1-4957-907e-7597405691a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb9f8f-d4a0-4329-b49e-f884bcf35681", "name": "network-vif-plugged", "status": "completed", "tag": "7cd7187b-41bd-477b-985e-41fe4e886e86"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:22.990063 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:22.990063 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:59:22.999992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-4db68e13-56a8-4520-8baf-92836129543b req-b1d18f51-54c1-4957-907e-7597405691a5 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.000695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-4db68e13-56a8-4520-8baf-92836129543b req-b1d18f51-54c1-4957-907e-7597405691a5 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.018983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-4db68e13-56a8-4520-8baf-92836129543b req-b1d18f51-54c1-4957-907e-7597405691a5 service nova] Creating event network-vif-plugged:7cd7187b-41bd-477b-985e-41fe4e886e86 for instance fefb9f8f-d4a0-4329-b49e-f884bcf35681 on hv-cinder-80600 Sep 15 08:59:23.023951 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-4db68e13-56a8-4520-8baf-92836129543b req-b1d18f51-54c1-4957-907e-7597405691a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078351 Sep 15 08:59:23.025571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 151/288] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:23.036757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c6d1c7f9-76db-4397-9640-6c477f94475d tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6567790>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:23.100378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c6d1c7f9-76db-4397-9640-6c477f94475d tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431" status: 200 len: 287 microversion: 2.1 time: 0.072823 Sep 15 08:59:23.100951 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 152/289] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Sep 15 08:59:23 2021] GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:23.122251 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f96190fc-f962-4c3e-9eab-916d641d10e3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:23.123180 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f96190fc-f962-4c3e-9eab-916d641d10e3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:23.150279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-798acf72-8c41-44cb-abaf-6ffbe20bf568 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 25066 microversion: 2.1 time: 0.239228 Sep 15 08:59:23.154256 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 138/290] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:22 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 25066 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:23.161867 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:23.162795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:23.170881 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.171335 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.172251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.172824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.283945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f96190fc-f962-4c3e-9eab-916d641d10e3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:23.300250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f96190fc-f962-4c3e-9eab-916d641d10e3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1214 microversion: 2.1 time: 0.194596 Sep 15 08:59:23.301555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 153/291] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:23 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:23.331858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:23.332740 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:23.345299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.346029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.347015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.347630 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.442594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:23.451923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-02cc0e76-15dc-437e-876c-23a24f54a44e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.299750 Sep 15 08:59:23.452463 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 139/292] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:23 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:23.540674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:23.545851 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:23.551211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.551992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.554410 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.555236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.803506 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:23.816257 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-295a94a9-9139-408b-997c-1ca018ff3b84 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.502454 Sep 15 08:59:23.817211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 154/293] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:23 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:23.873206 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:23.891414 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-63f6d853-90b1-4250-a23f-dcdeeebe7d24 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.362242 Sep 15 08:59:23.891964 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 140/294] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:23 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:23.926546 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-541f40f6-de39-4b7e-ae0a-ca4dc865e6cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:23.927792 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-541f40f6-de39-4b7e-ae0a-ca4dc865e6cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:23.935803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-541f40f6-de39-4b7e-ae0a-ca4dc865e6cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.936256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-541f40f6-de39-4b7e-ae0a-ca4dc865e6cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:23.937058 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-541f40f6-de39-4b7e-ae0a-ca4dc865e6cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:23.937491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-541f40f6-de39-4b7e-ae0a-ca4dc865e6cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.092979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-541f40f6-de39-4b7e-ae0a-ca4dc865e6cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 25959 microversion: 2.20 time: 0.175693 Sep 15 08:59:24.093620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 155/295] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:23 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 25959 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:24.117493 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6f476eab-6007-4f22-8459-1d95f97a7d37 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6587e50>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:24.171968 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d470ec93-4295-42df-8bff-296574c69b4d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:24.173921 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d470ec93-4295-42df-8bff-296574c69b4d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:24.176395 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-6f476eab-6007-4f22-8459-1d95f97a7d37 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] HTTP exception thrown: Snapshot 0d5a4c92-e70b-47b4-8a13-6ba6418b9431 could not be found. Sep 15 08:59:24.176992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6f476eab-6007-4f22-8459-1d95f97a7d37 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Returning 404 to user: Snapshot 0d5a4c92-e70b-47b4-8a13-6ba6418b9431 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:24.177939 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6f476eab-6007-4f22-8459-1d95f97a7d37 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431" status: 404 len: 111 microversion: 2.1 time: 0.069898 Sep 15 08:59:24.178659 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 141/296] 10.222.0.39 () {58 vars in 1251 bytes} [Wed Sep 15 08:59:24 2021] GET /compute/v2.1/os-snapshots/0d5a4c92-e70b-47b4-8a13-6ba6418b9431 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 08:59:24.183587 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d470ec93-4295-42df-8bff-296574c69b4d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.188868 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d470ec93-4295-42df-8bff-296574c69b4d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.188868 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d470ec93-4295-42df-8bff-296574c69b4d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.188868 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d470ec93-4295-42df-8bff-296574c69b4d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.195485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b9b0be3e-3531-4563-bddb-5638de36036a tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6929d30>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:24.464184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b9b0be3e-3531-4563-bddb-5638de36036a tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0" status: 202 len: 0 microversion: 2.1 time: 0.280601 Sep 15 08:59:24.464740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 142/297] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Sep 15 08:59:24 2021] DELETE /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:24.482821 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:24.483425 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:24.490584 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d470ec93-4295-42df-8bff-296574c69b4d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 26254 microversion: 2.1 time: 0.330039 Sep 15 08:59:24.491580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.495305 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.495305 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.495305 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.496116 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 156/298] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:24 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 26254 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:59:24.508095 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:24.509587 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:24.517828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.518769 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.519805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.523602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.614052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:24.622374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7072be2d-92d4-4941-ab8f-fc74ff6fa7c8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1210 microversion: 2.1 time: 0.156522 Sep 15 08:59:24.622907 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 143/299] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:24 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1210 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:24.632901 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7ccbdad0-f1f0-497c-b659-d8c876844219 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec64810d0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:24.735869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7ccbdad0-f1f0-497c-b659-d8c876844219 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0" status: 200 len: 345 microversion: 2.1 time: 0.111924 Sep 15 08:59:24.736428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 144/300] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:24 2021] GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:24.746429 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-ebd81151-1d4d-43f9-a4a9-b21fad349d1b req-0a916dc7-1b5d-4f43-afb4-8c7a9f2f2822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d9451c-a5e9-4981-b5d2-2d2b2984ef06", "tag": "e49b8f0c-352a-44c7-977f-0d7124307c06"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:24.752784 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:24.752784 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:59:24.762451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-ebd81151-1d4d-43f9-a4a9-b21fad349d1b req-0a916dc7-1b5d-4f43-afb4-8c7a9f2f2822 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.762890 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-ebd81151-1d4d-43f9-a4a9-b21fad349d1b req-0a916dc7-1b5d-4f43-afb4-8c7a9f2f2822 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.779523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-ebd81151-1d4d-43f9-a4a9-b21fad349d1b req-0a916dc7-1b5d-4f43-afb4-8c7a9f2f2822 service nova] Creating event network-changed:e49b8f0c-352a-44c7-977f-0d7124307c06 for instance 33d9451c-a5e9-4981-b5d2-2d2b2984ef06 on hv-cinder-80600 Sep 15 08:59:24.784272 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-ebd81151-1d4d-43f9-a4a9-b21fad349d1b req-0a916dc7-1b5d-4f43-afb4-8c7a9f2f2822 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046725 Sep 15 08:59:24.784856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 145/301] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:24.804664 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:24.812632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2251f64b-7829-4e75-b2fb-2c4f4517927b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.315189 Sep 15 08:59:24.813148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 157/302] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:24 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:24.839356 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:24.840058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:24.847593 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.848024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.848790 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.849220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.912386 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:24.912904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:24.920543 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.924989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:24.924989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:24.924989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.076362 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:25.085158 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ab44ca40-9d40-49fb-a12f-d044b2ce8f52 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1318 microversion: 2.1 time: 0.256107 Sep 15 08:59:25.098646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 146/303] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:24 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:25.110852 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-96302c93-0adc-4f33-95c2-57d15e24c5ed tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:25.111819 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-96302c93-0adc-4f33-95c2-57d15e24c5ed tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:25.119866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-96302c93-0adc-4f33-95c2-57d15e24c5ed tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.120874 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-96302c93-0adc-4f33-95c2-57d15e24c5ed tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.121168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-96302c93-0adc-4f33-95c2-57d15e24c5ed tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.121594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-96302c93-0adc-4f33-95c2-57d15e24c5ed tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.328565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-96302c93-0adc-4f33-95c2-57d15e24c5ed tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 26716 microversion: 2.20 time: 0.227371 Sep 15 08:59:25.329203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 147/304] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:25 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 26716 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:25.410129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:25.419086 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-488c002f-97fd-496d-b4f2-500e96d9cb28 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.515916 Sep 15 08:59:25.419757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 158/305] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:24 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:25.511684 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-80b45c57-8b9f-42a7-b2c5-6d0e9bca0527 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:25.512673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-80b45c57-8b9f-42a7-b2c5-6d0e9bca0527 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:25.522028 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-80b45c57-8b9f-42a7-b2c5-6d0e9bca0527 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.522505 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-80b45c57-8b9f-42a7-b2c5-6d0e9bca0527 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.523279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-80b45c57-8b9f-42a7-b2c5-6d0e9bca0527 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.523700 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-80b45c57-8b9f-42a7-b2c5-6d0e9bca0527 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.653576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:25.654472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:25.663999 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.664444 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.665959 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.666459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.728256 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-80b45c57-8b9f-42a7-b2c5-6d0e9bca0527 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 26957 microversion: 2.1 time: 0.226552 Sep 15 08:59:25.732301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 148/306] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:25 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 26957 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:25.754112 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-67b2881e-272b-4129-957f-f1546234f436 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec6689280>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:25.797075 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:25.807595 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8106e73e-6525-494a-b985-16c661fb982f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1266 microversion: 2.1 time: 0.171949 Sep 15 08:59:25.808282 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 159/307] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:25 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:25.823266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-67b2881e-272b-4129-957f-f1546234f436 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] HTTP exception thrown: Volume c62aa1f0-d27a-45b4-92a5-d7eb60397af0 could not be found. Sep 15 08:59:25.823946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-67b2881e-272b-4129-957f-f1546234f436 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Returning 404 to user: Volume c62aa1f0-d27a-45b4-92a5-d7eb60397af0 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:25.825042 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-67b2881e-272b-4129-957f-f1546234f436 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0" status: 404 len: 109 microversion: 2.1 time: 0.080846 Sep 15 08:59:25.825786 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 149/308] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:25 2021] GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 08:59:25.836396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:25.836396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:25.844945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.845570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.846366 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:25.846798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:25.847674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-009045c5-03e4-45ee-9476-330aae268c26 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec658e0d0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:25.926042 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-009045c5-03e4-45ee-9476-330aae268c26 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] HTTP exception thrown: Volume c62aa1f0-d27a-45b4-92a5-d7eb60397af0 could not be found. Sep 15 08:59:25.926673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-009045c5-03e4-45ee-9476-330aae268c26 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Returning 404 to user: Volume c62aa1f0-d27a-45b4-92a5-d7eb60397af0 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:25.932035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-009045c5-03e4-45ee-9476-330aae268c26 tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0" status: 404 len: 109 microversion: 2.1 time: 0.096268 Sep 15 08:59:25.932035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 150/309] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Sep 15 08:59:25 2021] DELETE /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 08:59:25.942140 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6edd099d-df24-49b8-b6cf-ffd0c31fcf9f tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Calling method '.version_select at 0x7f1ec67cd4c0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:26.015355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-6edd099d-df24-49b8-b6cf-ffd0c31fcf9f tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] HTTP exception thrown: Volume c62aa1f0-d27a-45b4-92a5-d7eb60397af0 could not be found. Sep 15 08:59:26.015972 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6edd099d-df24-49b8-b6cf-ffd0c31fcf9f tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] Returning 404 to user: Volume c62aa1f0-d27a-45b4-92a5-d7eb60397af0 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:26.016800 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6edd099d-df24-49b8-b6cf-ffd0c31fcf9f tempest-VolumesSnapshotsTestJSON-1628184783 tempest-VolumesSnapshotsTestJSON-1628184783-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0" status: 404 len: 109 microversion: 2.1 time: 0.084784 Sep 15 08:59:26.017606 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 151/310] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:25 2021] GET /compute/v2.1/os-volumes/c62aa1f0-d27a-45b4-92a5-d7eb60397af0 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 08:59:26.107885 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:26.126823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:26.136413 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.137076 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:26.138002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.138663 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:26.265739 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:26.284542 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dbd7d9a6-fd42-48b6-b2dc-70da48394a8a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.459546 Sep 15 08:59:26.285303 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 160/311] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:25 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:26.349309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a6414f83-8cec-441d-81de-f3b3aa69202a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:26.354537 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a6414f83-8cec-441d-81de-f3b3aa69202a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:26.365973 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a6414f83-8cec-441d-81de-f3b3aa69202a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.366697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a6414f83-8cec-441d-81de-f3b3aa69202a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:26.368693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a6414f83-8cec-441d-81de-f3b3aa69202a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.369249 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a6414f83-8cec-441d-81de-f3b3aa69202a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:26.544535 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:26.553621 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-feb44379-266f-4a06-b247-68d6e1603ce9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1508 microversion: 2.1 time: 0.455523 Sep 15 08:59:26.554991 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 152/312] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:26 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:26.568005 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:26.568850 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:26.581037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a6414f83-8cec-441d-81de-f3b3aa69202a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 27184 microversion: 2.20 time: 0.243886 Sep 15 08:59:26.581988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 161/313] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:26 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 27184 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 08:59:26.591649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.594205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:26.595491 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.598793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:26.606031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37e07dda-b076-4902-ad66-37f9305c9d2b"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:26.608426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:26.628964 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.629433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:26.630465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:26.630889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.232591 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:27.243793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-81b47aa4-1929-4916-a525-76814e2583b4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.686763 Sep 15 08:59:27.245403 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 153/314] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:26 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:27.263647 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8c64df2d-9755-43da-97c2-eceeaccb6d2d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:27.264663 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8c64df2d-9755-43da-97c2-eceeaccb6d2d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:27.272744 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c64df2d-9755-43da-97c2-eceeaccb6d2d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.273191 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c64df2d-9755-43da-97c2-eceeaccb6d2d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.273962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c64df2d-9755-43da-97c2-eceeaccb6d2d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.274938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c64df2d-9755-43da-97c2-eceeaccb6d2d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.314334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume 37e07dda-b076-4902-ad66-37f9305c9d2b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-b1d96231-6a86-46e4-a1d7-4df74870743a) Sep 15 08:59:27.315807 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Returning 400 to user: Invalid input received: Invalid volume: Volume 37e07dda-b076-4902-ad66-37f9305c9d2b status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-b1d96231-6a86-46e4-a1d7-4df74870743a) {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:27.316905 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d44aa283-4e05-4bd1-ab84-878df9a2f2fb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.730791 Sep 15 08:59:27.317622 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 162/315] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 08:59:26 2021] POST /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681/os-volume_attachments => generated 279 bytes in 735 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 08:59:27.329437 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:27.330272 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:27.346413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.350266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.350266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.350266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.472174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8c64df2d-9755-43da-97c2-eceeaccb6d2d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 27537 microversion: 2.1 time: 0.214217 Sep 15 08:59:27.472174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 154/316] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:27 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 27537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:27.497250 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:27.498133 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:27.515565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.516226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.517148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.517798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.802878 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:27.812393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9fcf382f-2b78-4a7c-8388-6f0b86360663 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.493319 Sep 15 08:59:27.813201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 163/317] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:27 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:27.815580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:27.823987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-192d0da7-cc5b-4d40-908c-4e4341db90c5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:27.824688 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-192d0da7-cc5b-4d40-908c-4e4341db90c5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:27.824806 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7335aca1-7c8f-41be-bd17-ce0d667541aa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.356467 Sep 15 08:59:27.825237 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 155/318] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:27 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:27.832530 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-192d0da7-cc5b-4d40-908c-4e4341db90c5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.833157 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-192d0da7-cc5b-4d40-908c-4e4341db90c5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.834242 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-192d0da7-cc5b-4d40-908c-4e4341db90c5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.834837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-192d0da7-cc5b-4d40-908c-4e4341db90c5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.835302 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d04f3658-8984-481e-88ae-78e86322c814 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:27.836215 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d04f3658-8984-481e-88ae-78e86322c814 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:27.847831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d04f3658-8984-481e-88ae-78e86322c814 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.852857 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d04f3658-8984-481e-88ae-78e86322c814 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:27.853817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d04f3658-8984-481e-88ae-78e86322c814 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:27.854415 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d04f3658-8984-481e-88ae-78e86322c814 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.275745 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d04f3658-8984-481e-88ae-78e86322c814 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 27586 microversion: 2.20 time: 0.449224 Sep 15 08:59:28.279887 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 156/319] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:27 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 27586 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:28.291433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:28.292051 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:28.300052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.300495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.301257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.301686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.319720 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-192d0da7-cc5b-4d40-908c-4e4341db90c5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments/37e07dda-b076-4902-ad66-37f9305c9d2b" status: 202 len: 0 microversion: 2.1 time: 0.505396 Sep 15 08:59:28.320690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 164/320] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 08:59:27 2021] DELETE /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments/37e07dda-b076-4902-ad66-37f9305c9d2b => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:28.338329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-21e8984b-a6de-4b30-8812-0dd0830ae6d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:28.340075 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-21e8984b-a6de-4b30-8812-0dd0830ae6d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:28.349433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21e8984b-a6de-4b30-8812-0dd0830ae6d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.350023 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21e8984b-a6de-4b30-8812-0dd0830ae6d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.351153 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21e8984b-a6de-4b30-8812-0dd0830ae6d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.352164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21e8984b-a6de-4b30-8812-0dd0830ae6d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.443448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-21e8984b-a6de-4b30-8812-0dd0830ae6d4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118217 Sep 15 08:59:28.444620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 165/321] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 08:59:28 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:59:28.505391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c41cbd39-4545-4c64-b15b-86b17ff5e349 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:28.509591 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c41cbd39-4545-4c64-b15b-86b17ff5e349 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:28.526941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c41cbd39-4545-4c64-b15b-86b17ff5e349 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.527403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c41cbd39-4545-4c64-b15b-86b17ff5e349 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.528300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c41cbd39-4545-4c64-b15b-86b17ff5e349 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.528737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c41cbd39-4545-4c64-b15b-86b17ff5e349 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.675686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:28.688939 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e1e20167-30d0-47b1-b70d-036c47a5a1f9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.407569 Sep 15 08:59:28.690132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 157/322] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:28 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:28.753849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c41cbd39-4545-4c64-b15b-86b17ff5e349 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 27872 microversion: 2.1 time: 0.278421 Sep 15 08:59:28.755306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 166/323] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:28 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 27872 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:28.834943 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:28.835541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:28.843731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.844389 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.845300 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.845874 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.855051 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:28.856028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:28.866393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.875466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:28.875466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:28.875466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.102103 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:29.122166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-96f389f9-ec34-4bcb-8f19-81d100bd3ab3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1522 microversion: 2.1 time: 0.283623 Sep 15 08:59:29.122946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 167/324] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:28 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:29.134019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-87c6ea89-4864-485c-aadc-6744bbc15a70 req-1034eac4-e5d9-444d-afb3-40cbd905e35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3345c950-5ef1-41b8-961a-bbab9d6fcbf7", "tag": "5b1d3897-ee7e-462d-a10b-aa48748e0837"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:29.140406 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:29.140406 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:59:29.148537 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-87c6ea89-4864-485c-aadc-6744bbc15a70 req-1034eac4-e5d9-444d-afb3-40cbd905e35d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.148976 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-87c6ea89-4864-485c-aadc-6744bbc15a70 req-1034eac4-e5d9-444d-afb3-40cbd905e35d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.179764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-87c6ea89-4864-485c-aadc-6744bbc15a70 req-1034eac4-e5d9-444d-afb3-40cbd905e35d service nova] Creating event network-changed:5b1d3897-ee7e-462d-a10b-aa48748e0837 for instance 3345c950-5ef1-41b8-961a-bbab9d6fcbf7 on hv-cinder-80600 Sep 15 08:59:29.192819 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-87c6ea89-4864-485c-aadc-6744bbc15a70 req-1034eac4-e5d9-444d-afb3-40cbd905e35d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059992 Sep 15 08:59:29.195796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 168/325] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:29.293659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6af8c48c-19a0-4642-b382-03bd84e76d89 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:29.294696 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6af8c48c-19a0-4642-b382-03bd84e76d89 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:29.302335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6af8c48c-19a0-4642-b382-03bd84e76d89 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.303109 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6af8c48c-19a0-4642-b382-03bd84e76d89 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.304022 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6af8c48c-19a0-4642-b382-03bd84e76d89 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.304622 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6af8c48c-19a0-4642-b382-03bd84e76d89 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.519014 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6af8c48c-19a0-4642-b382-03bd84e76d89 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 27802 microversion: 2.20 time: 0.234778 Sep 15 08:59:29.523000 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 169/326] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:29 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 27802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 08:59:29.536259 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-53ad4251-79ac-4bf4-8ad7-e8a1b3fa4d08 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:29.537384 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-53ad4251-79ac-4bf4-8ad7-e8a1b3fa4d08 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:29.537779 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:29.560217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f6e33ba2-10e5-4cf4-9935-a482d32f6ebb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.734242 Sep 15 08:59:29.561325 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 158/327] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:28 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:29.586936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53ad4251-79ac-4bf4-8ad7-e8a1b3fa4d08 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.586936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53ad4251-79ac-4bf4-8ad7-e8a1b3fa4d08 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.586936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53ad4251-79ac-4bf4-8ad7-e8a1b3fa4d08 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.586936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53ad4251-79ac-4bf4-8ad7-e8a1b3fa4d08 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.683573 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-53ad4251-79ac-4bf4-8ad7-e8a1b3fa4d08 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162606 Sep 15 08:59:29.684514 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 170/328] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 08:59:29 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:29.711210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:29.714346 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:29.721859 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.722607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.723610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.724327 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.777793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a3a65893-0e8e-4168-a607-5373fcb6df00 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:29.780585 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a3a65893-0e8e-4168-a607-5373fcb6df00 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:29.800816 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3a65893-0e8e-4168-a607-5373fcb6df00 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.801267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3a65893-0e8e-4168-a607-5373fcb6df00 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.802055 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3a65893-0e8e-4168-a607-5373fcb6df00 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:29.802528 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3a65893-0e8e-4168-a607-5373fcb6df00 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:29.985648 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a3a65893-0e8e-4168-a607-5373fcb6df00 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28014 microversion: 2.1 time: 0.219892 Sep 15 08:59:29.986681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 171/329] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:29 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28014 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:30.146141 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:30.146840 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:30.158134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.158862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.160134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.161323 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.336274 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:30.346461 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-975f31e2-47be-423a-8139-a16ddf91857d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.644755 Sep 15 08:59:30.347354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 159/330] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:29 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:30.445693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:30.454981 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-25e2d366-aa1f-4cc1-8da9-2b7c16da13e2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1502 microversion: 2.1 time: 0.318752 Sep 15 08:59:30.455775 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 172/331] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:30 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:30.478055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:30.479146 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:30.488137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.488754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.489729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.490388 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.541390 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d41d2b32-db47-4002-96c0-7fa6c4329324 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:30.542413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d41d2b32-db47-4002-96c0-7fa6c4329324 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:30.560680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d41d2b32-db47-4002-96c0-7fa6c4329324 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.563227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d41d2b32-db47-4002-96c0-7fa6c4329324 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.564314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d41d2b32-db47-4002-96c0-7fa6c4329324 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.564939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d41d2b32-db47-4002-96c0-7fa6c4329324 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.767351 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d41d2b32-db47-4002-96c0-7fa6c4329324 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28186 microversion: 2.20 time: 0.239187 Sep 15 08:59:30.773485 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 173/332] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:30 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28186 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:30.801209 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:30.801910 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:30.819939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.820385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.821691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.822143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.913737 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:30.935021 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-041cc0fb-a725-4569-b22b-0b98bef9103e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1515 microversion: 2.1 time: 0.467067 Sep 15 08:59:30.935796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 160/333] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:30 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:30.959248 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8c470cea-31fa-4614-87df-5077441b5bce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:30.963599 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8c470cea-31fa-4614-87df-5077441b5bce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:30.975147 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c470cea-31fa-4614-87df-5077441b5bce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.985721 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c470cea-31fa-4614-87df-5077441b5bce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:30.986906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c470cea-31fa-4614-87df-5077441b5bce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:30.987556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c470cea-31fa-4614-87df-5077441b5bce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:31.083614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8c470cea-31fa-4614-87df-5077441b5bce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146309 Sep 15 08:59:31.084737 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 161/334] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 08:59:30 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:31.097600 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2b6cba4e-b270-430c-ae16-9e7e2c8b1a0e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:31.098792 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2b6cba4e-b270-430c-ae16-9e7e2c8b1a0e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:31.106564 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b6cba4e-b270-430c-ae16-9e7e2c8b1a0e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:31.108328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b6cba4e-b270-430c-ae16-9e7e2c8b1a0e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:31.108328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b6cba4e-b270-430c-ae16-9e7e2c8b1a0e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:31.108962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b6cba4e-b270-430c-ae16-9e7e2c8b1a0e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:31.120148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:31.140017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fd1e272f-59b2-4a0b-a9a8-c66b0745086f tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.363702 Sep 15 08:59:31.151334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 174/335] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:30 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:31.297294 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2b6cba4e-b270-430c-ae16-9e7e2c8b1a0e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28183 microversion: 2.1 time: 0.210883 Sep 15 08:59:31.297957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 162/336] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:31 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:31.377636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:31.378524 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:31.386671 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:31.387217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:31.388060 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:31.388560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:31.671056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:31.687961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-afeb2d68-9486-4bce-8c4a-bd69fb1e4491 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.321927 Sep 15 08:59:31.690196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 175/337] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:31 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:31.691101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-770479265", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "1c409703-0674-4cbb-9f3e-f398f357604d"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:31.767377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] validate_networks() for [('1c409703-0674-4cbb-9f3e-f398f357604d', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:59:31.785262 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dd0683ca-4a93-45df-8919-b1e99d7e5de9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:31.790731 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dd0683ca-4a93-45df-8919-b1e99d7e5de9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:31.798456 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd0683ca-4a93-45df-8919-b1e99d7e5de9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:31.799077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd0683ca-4a93-45df-8919-b1e99d7e5de9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:31.799965 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd0683ca-4a93-45df-8919-b1e99d7e5de9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:31.800847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd0683ca-4a93-45df-8919-b1e99d7e5de9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:31.987560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dd0683ca-4a93-45df-8919-b1e99d7e5de9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28186 microversion: 2.20 time: 0.211163 Sep 15 08:59:31.988473 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 176/338] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:31 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28186 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 08:59:32.114120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-40f548f8-accd-44fb-acb7-17047e152177 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec6797160>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:32.210995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-40f548f8-accd-44fb-acb7-17047e152177 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/09caf354-e20e-4e10-a7b7-58a18a239f33" status: 200 len: 351 microversion: 2.1 time: 0.106534 Sep 15 08:59:32.212267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 177/339] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:32 2021] GET /compute/v2.1/os-volumes/09caf354-e20e-4e10-a7b7-58a18a239f33 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:59:32.222839 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:32.223643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:32.232351 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.232795 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.233768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.234231 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.400914 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:59:32.401331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:59:32.401793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:59:32.402230 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:59:32.402663 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:59:32.411093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.411530 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.412318 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.412740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.430942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:59:32.435167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for user aa9a7f77c7354c099697032b66c9a99a and project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:59:32.445650 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:59:32.448808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:59:32.453347 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:32.461470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7daa695b-85ce-493d-ae4b-00d2d3e0f193 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.248183 Sep 15 08:59:32.462141 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 178/340] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:32 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:32.472663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4947323f-5bf7-4fdf-b2e3-9d43be385c50 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:32.473580 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4947323f-5bf7-4fdf-b2e3-9d43be385c50 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:32.480661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4947323f-5bf7-4fdf-b2e3-9d43be385c50 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.481109 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4947323f-5bf7-4fdf-b2e3-9d43be385c50 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.481878 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4947323f-5bf7-4fdf-b2e3-9d43be385c50 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.482364 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4947323f-5bf7-4fdf-b2e3-9d43be385c50 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.557143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fd4c2d46-79dd-403f-96c9-627acfe6b5a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876425 Sep 15 08:59:32.557848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 163/341] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:59:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 08:59:32.573599 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3f560dd0-f45f-4dcf-a453-2189ead9ecce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:32.574333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3f560dd0-f45f-4dcf-a453-2189ead9ecce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:32.643712 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4947323f-5bf7-4fdf-b2e3-9d43be385c50 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28183 microversion: 2.1 time: 0.180235 Sep 15 08:59:32.644823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 179/342] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:32 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:32.673397 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3f560dd0-f45f-4dcf-a453-2189ead9ecce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:32.685130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3f560dd0-f45f-4dcf-a453-2189ead9ecce tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1217 microversion: 2.1 time: 0.121151 Sep 15 08:59:32.685776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 164/343] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:32 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:32.711613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:32.712371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:32.720798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.721235 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.728320 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:32.728320 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:32.931313 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:32.940077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-17ea6462-3019-4216-8890-f7688a3566e4 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.238675 Sep 15 08:59:32.940654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 180/344] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:32 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:33.005178 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-21ea70f8-91a7-4cf9-8ae6-630cc6e4813f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:33.007758 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-21ea70f8-91a7-4cf9-8ae6-630cc6e4813f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:33.015789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21ea70f8-91a7-4cf9-8ae6-630cc6e4813f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.016423 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21ea70f8-91a7-4cf9-8ae6-630cc6e4813f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.017345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21ea70f8-91a7-4cf9-8ae6-630cc6e4813f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.019137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21ea70f8-91a7-4cf9-8ae6-630cc6e4813f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.105901 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:33.107120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:33.116718 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.117430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.119452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.120367 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.167861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-21ea70f8-91a7-4cf9-8ae6-630cc6e4813f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28477 microversion: 2.20 time: 0.170851 Sep 15 08:59:33.168086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 165/345] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:32 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28477 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:33.205687 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'flavor' on Instance uuid 26d8f72b-fc30-41ab-922d-6e83c2b253e1 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 08:59:33.484172 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:33.484766 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:33.492912 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.493349 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.494126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.494553 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.558533 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9959aaa4-74da-45c0-a9b7-d55a1ae53c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action" status: 200 len: 32 microversion: 2.1 time: 0.466322 Sep 15 08:59:33.559067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 181/346] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:33 2021] POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 08:59:33.574767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:33.575489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:33.582996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.583448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.584225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.590252 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.706506 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:33.715334 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-835cded2-4206-4ad7-819f-fc8c2d322ac3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.241284 Sep 15 08:59:33.715863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 166/347] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:33 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:33.727656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c8c6908b-b29f-4ea5-bf09-7f8c6bdfe3cd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:33.728615 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c8c6908b-b29f-4ea5-bf09-7f8c6bdfe3cd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:33.738299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8c6908b-b29f-4ea5-bf09-7f8c6bdfe3cd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.738299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8c6908b-b29f-4ea5-bf09-7f8c6bdfe3cd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.738299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8c6908b-b29f-4ea5-bf09-7f8c6bdfe3cd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.738299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8c6908b-b29f-4ea5-bf09-7f8c6bdfe3cd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.805179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:33.824650 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-34aad3a4-681e-4108-a384-5dec9eee5e9f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.260092 Sep 15 08:59:33.825201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 182/348] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:33 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:33.836140 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:33.837725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:33.845065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.845509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.846301 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.846730 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.912398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c8c6908b-b29f-4ea5-bf09-7f8c6bdfe3cd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28474 microversion: 2.1 time: 0.194953 Sep 15 08:59:33.913970 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 167/349] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:33 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28474 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:33.963389 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:33.963826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:33.971524 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:33.972500 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.972999 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.973991 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:33.974566 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:33.979694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dbb76bd5-ec4b-4cb8-bf9b-eabf9128468c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1221 microversion: 2.1 time: 0.153488 Sep 15 08:59:33.980224 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 183/350] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:33 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:34.185595 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-23a3d766-13bc-4590-96f1-f683b1946f92 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:34.186558 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-23a3d766-13bc-4590-96f1-f683b1946f92 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:34.193766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-23a3d766-13bc-4590-96f1-f683b1946f92 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:34.194241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-23a3d766-13bc-4590-96f1-f683b1946f92 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:34.195009 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-23a3d766-13bc-4590-96f1-f683b1946f92 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:34.201092 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-23a3d766-13bc-4590-96f1-f683b1946f92 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:34.315089 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:34.323201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8ce5959a-bdea-4759-a55c-8e3b4c3847cf tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.370018 Sep 15 08:59:34.323886 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 168/351] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:33 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:34.334443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-027ac69b-0588-4afe-af78-70bef64e1a93 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec65c59d0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:34.361576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-23a3d766-13bc-4590-96f1-f683b1946f92 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28477 microversion: 2.20 time: 0.185796 Sep 15 08:59:34.362223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 184/352] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:34 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28477 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:34.433120 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-027ac69b-0588-4afe-af78-70bef64e1a93 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fdbff155-0411-490b-8833-6acbe9fa25f4" status: 200 len: 351 microversion: 2.1 time: 0.108210 Sep 15 08:59:34.433966 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 169/353] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:34 2021] GET /compute/v2.1/os-volumes/fdbff155-0411-490b-8833-6acbe9fa25f4 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:34.739909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:34.740821 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:34.761803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:34.762299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:34.763758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:34.764263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:34.848820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:34.849430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:34.870476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:34.871045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:34.871702 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:34.872122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.045506 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:35.055879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5122db07-62fc-434a-8da9-06bca2103623 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.326011 Sep 15 08:59:35.066168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 185/354] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:34 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:35.077699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2ed1f0df-b71a-4ebc-8b0a-4d0ee23fb46b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:35.078968 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2ed1f0df-b71a-4ebc-8b0a-4d0ee23fb46b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:35.087432 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2ed1f0df-b71a-4ebc-8b0a-4d0ee23fb46b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.088240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2ed1f0df-b71a-4ebc-8b0a-4d0ee23fb46b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.089226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2ed1f0df-b71a-4ebc-8b0a-4d0ee23fb46b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.090834 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2ed1f0df-b71a-4ebc-8b0a-4d0ee23fb46b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.238420 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:35.248022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a74837e7-65d9-4464-b707-05b076a02463 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.410099 Sep 15 08:59:35.249070 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 170/355] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:34 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:35.260418 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:35.261220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:35.269528 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.270440 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.271269 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2ed1f0df-b71a-4ebc-8b0a-4d0ee23fb46b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28641 microversion: 2.1 time: 0.200739 Sep 15 08:59:35.271664 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.272319 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.273775 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 186/356] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:35 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28641 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:35.301551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-7cf9cef9-7b0c-4639-9fbd-8cc81a048ac1 req-faa240ff-bad3-4d22-91b9-d1c192531701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d9451c-a5e9-4981-b5d2-2d2b2984ef06", "name": "network-vif-plugged", "status": "completed", "tag": "e49b8f0c-352a-44c7-977f-0d7124307c06"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:35.309421 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:35.309421 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:59:35.354284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-7cf9cef9-7b0c-4639-9fbd-8cc81a048ac1 req-faa240ff-bad3-4d22-91b9-d1c192531701 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.354284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-7cf9cef9-7b0c-4639-9fbd-8cc81a048ac1 req-faa240ff-bad3-4d22-91b9-d1c192531701 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.386003 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-7cf9cef9-7b0c-4639-9fbd-8cc81a048ac1 req-faa240ff-bad3-4d22-91b9-d1c192531701 service nova] Creating event network-vif-plugged:e49b8f0c-352a-44c7-977f-0d7124307c06 for instance 33d9451c-a5e9-4981-b5d2-2d2b2984ef06 on hv-cinder-80600 Sep 15 08:59:35.390615 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-7cf9cef9-7b0c-4639-9fbd-8cc81a048ac1 req-faa240ff-bad3-4d22-91b9-d1c192531701 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114919 Sep 15 08:59:35.393742 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 187/357] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:35.405900 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:35.406826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:35.414828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.416162 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.416162 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.416472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.434603 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:35.444698 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-499483d4-71f0-4ed3-b9a5-eb44e71efae4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1269 microversion: 2.1 time: 0.194246 Sep 15 08:59:35.445232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 171/358] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:35 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:35.482133 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f818cc59-d6de-4365-a450-ce89fe764816 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:35.483753 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f818cc59-d6de-4365-a450-ce89fe764816 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:35.493823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f818cc59-d6de-4365-a450-ce89fe764816 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.494387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f818cc59-d6de-4365-a450-ce89fe764816 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.495466 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f818cc59-d6de-4365-a450-ce89fe764816 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:35.496655 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f818cc59-d6de-4365-a450-ce89fe764816 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:35.684094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f818cc59-d6de-4365-a450-ce89fe764816 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28645 microversion: 2.20 time: 0.235789 Sep 15 08:59:35.685592 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 172/359] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:35 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28645 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:35.917574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:35.926389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ffa6c28f-6306-41e7-8b08-23f6974d3c25 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.530818 Sep 15 08:59:35.927321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 188/360] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:35 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:36.078522 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:36.079216 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:36.087873 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.088747 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.089738 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.090403 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.271597 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:36.272328 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:36.282991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.283725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.284880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.285422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.503459 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:36.512526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7f101db9-f0b9-4b66-9e45-eeb723f49d59 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.443562 Sep 15 08:59:36.513052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 173/361] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:36 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:36.531356 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-25c630f9-5d56-4d1e-9deb-c1b88e7ee84d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:36.532920 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-25c630f9-5d56-4d1e-9deb-c1b88e7ee84d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:36.540369 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25c630f9-5d56-4d1e-9deb-c1b88e7ee84d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.540804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25c630f9-5d56-4d1e-9deb-c1b88e7ee84d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.541612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25c630f9-5d56-4d1e-9deb-c1b88e7ee84d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.542032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25c630f9-5d56-4d1e-9deb-c1b88e7ee84d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.587553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:36.595864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c43bdfc9-fb11-4826-a54b-c204ac84f20e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.334765 Sep 15 08:59:36.597721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 189/362] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:36 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:36.608825 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5b7a506f-8c9e-4a12-b0d9-890f5dadf882 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec67fc040>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:36.713870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5b7a506f-8c9e-4a12-b0d9-890f5dadf882 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/b7c09fdc-f83e-4693-a9ec-48c54a8d28d2" status: 200 len: 350 microversion: 2.1 time: 0.114892 Sep 15 08:59:36.714460 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 190/363] 10.222.0.39 () {58 vars in 1245 bytes} [Wed Sep 15 08:59:36 2021] GET /compute/v2.1/os-volumes/b7c09fdc-f83e-4693-a9ec-48c54a8d28d2 => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:36.724544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:36.725133 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:36.733504 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.733947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.734754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.735190 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.846764 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-25c630f9-5d56-4d1e-9deb-c1b88e7ee84d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28641 microversion: 2.1 time: 0.332103 Sep 15 08:59:36.847396 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 174/364] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:36 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28641 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:36.864051 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-22c61e87-3ed1-465b-a8be-7f90dcb402b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:36.865058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-22c61e87-3ed1-465b-a8be-7f90dcb402b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:36.886760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-22c61e87-3ed1-465b-a8be-7f90dcb402b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.887204 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-22c61e87-3ed1-465b-a8be-7f90dcb402b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:36.887976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-22c61e87-3ed1-465b-a8be-7f90dcb402b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:36.888409 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-22c61e87-3ed1-465b-a8be-7f90dcb402b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.090053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-22c61e87-3ed1-465b-a8be-7f90dcb402b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28645 microversion: 2.20 time: 0.241085 Sep 15 08:59:37.090721 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 175/365] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:36 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28645 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:37.100977 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dc3c8f27-b464-43f6-9e24-9ec522e47fef tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec6710430>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.208733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dc3c8f27-b464-43f6-9e24-9ec522e47fef tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.116805 Sep 15 08:59:37.209286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 176/366] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:37.219639 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.220277 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:37.228854 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.229292 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.230303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.230878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.306285 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:37.315323 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e4b4f146-ce6a-434b-a047-ba76823e58dc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.599860 Sep 15 08:59:37.316844 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 191/367] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:36 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:37.327005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d1e5492a-1069-4177-8dee-a9710bc47e1d tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec62d3820>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.420415 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d1e5492a-1069-4177-8dee-a9710bc47e1d tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.102277 Sep 15 08:59:37.420962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 192/368] 10.222.0.39 () {58 vars in 1149 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:37.439286 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-df8a9b9a-5582-4894-928a-db397299fea3 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec688fdc0>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.466068 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:37.474430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b3848cce-7fb9-4ae4-9edb-50b999c67023 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1319 microversion: 2.1 time: 0.263896 Sep 15 08:59:37.475062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 177/369] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:37.529430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-df8a9b9a-5582-4894-928a-db397299fea3 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.100502 Sep 15 08:59:37.530120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 193/370] 10.222.0.39 () {58 vars in 1134 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:37.534619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.535236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:37.543406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.543897 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.544668 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.545096 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.546464 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5852efab-32e7-443f-9c7a-01ef0da8a0e6 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec62d3040>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.634526 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5852efab-32e7-443f-9c7a-01ef0da8a0e6 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097550 Sep 15 08:59:37.635201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 194/371] 10.222.0.39 () {58 vars in 1167 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:59:37.645869 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.646776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:37.657771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.658519 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.659510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.660147 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.763594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:37.773040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6f62008f-8c82-431f-8fc3-ce4ae1db7672 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.247578 Sep 15 08:59:37.773040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 178/372] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:37.783251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ca46afdf-35d9-42cc-8c07-59acd92ce966 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec67f1c10>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:37.869067 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ca46afdf-35d9-42cc-8c07-59acd92ce966 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095090 Sep 15 08:59:37.869618 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 179/373] 10.222.0.39 () {58 vars in 1170 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:37.881789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8e887157-ef2b-49a3-a509-2b5696d6ffbb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:37.882716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8e887157-ef2b-49a3-a509-2b5696d6ffbb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:37.891010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e887157-ef2b-49a3-a509-2b5696d6ffbb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.891457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e887157-ef2b-49a3-a509-2b5696d6ffbb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:37.892220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e887157-ef2b-49a3-a509-2b5696d6ffbb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:37.892650 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8e887157-ef2b-49a3-a509-2b5696d6ffbb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.162476 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:38.170794 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b9e5b406-4077-48c2-a523-2b4c67af020e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.534430 Sep 15 08:59:38.174498 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 195/374] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:37 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:38.185118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c00e9684-49fb-4d7f-b7e9-50e5b4141ea1 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec688f670>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:38.235580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8e887157-ef2b-49a3-a509-2b5696d6ffbb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28641 microversion: 2.1 time: 0.363796 Sep 15 08:59:38.236307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 180/375] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:37 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28641 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:38.248761 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-37aea7b3-022f-41eb-b11e-0fe79eecd6ba tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:38.249837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-37aea7b3-022f-41eb-b11e-0fe79eecd6ba tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:38.258135 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37aea7b3-022f-41eb-b11e-0fe79eecd6ba tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.259131 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37aea7b3-022f-41eb-b11e-0fe79eecd6ba tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.259962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37aea7b3-022f-41eb-b11e-0fe79eecd6ba tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.260454 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37aea7b3-022f-41eb-b11e-0fe79eecd6ba tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.278377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c00e9684-49fb-4d7f-b7e9-50e5b4141ea1 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.102422 Sep 15 08:59:38.278941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 196/376] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Sep 15 08:59:38 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:38.295511 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7cbca560-0ac9-454a-9e26-200a3ec969a5 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec66a2ca0>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:38.390555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7cbca560-0ac9-454a-9e26-200a3ec969a5 tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104147 Sep 15 08:59:38.400773 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 197/377] 10.222.0.39 () {58 vars in 1188 bytes} [Wed Sep 15 08:59:38 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:38.408865 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:38.409709 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:38.426122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-37aea7b3-022f-41eb-b11e-0fe79eecd6ba tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28645 microversion: 2.20 time: 0.188061 Sep 15 08:59:38.428333 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.429246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.430941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.431635 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.436240 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 181/378] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:38 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28645 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:38.458836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2966296b-e84a-46cd-9b37-8673ce5232cb tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] Calling method '.version_select at 0x7f1ec67f14c0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:38.578263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2966296b-e84a-46cd-9b37-8673ce5232cb tempest-VolumesTestJSON-1153716141 tempest-VolumesTestJSON-1153716141-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143545 Sep 15 08:59:38.578825 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 182/379] 10.222.0.39 () {58 vars in 1155 bytes} [Wed Sep 15 08:59:38 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:38.589012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-804ae1dc-7c99-44bf-a687-736339857204 req-d215c887-39a9-49d0-aaf4-184d7bc0c0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50af7e90-3b57-4e95-97b0-e298f753c007", "tag": "940aa7fc-de3e-46ed-ae69-062a759e8fdc"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:38.606676 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:38.606676 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:59:38.606676 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-804ae1dc-7c99-44bf-a687-736339857204 req-d215c887-39a9-49d0-aaf4-184d7bc0c0f8 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.607003 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-804ae1dc-7c99-44bf-a687-736339857204 req-d215c887-39a9-49d0-aaf4-184d7bc0c0f8 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.627798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-804ae1dc-7c99-44bf-a687-736339857204 req-d215c887-39a9-49d0-aaf4-184d7bc0c0f8 service nova] Creating event network-changed:940aa7fc-de3e-46ed-ae69-062a759e8fdc for instance 50af7e90-3b57-4e95-97b0-e298f753c007 on hv-cinder-80600 Sep 15 08:59:38.636530 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-804ae1dc-7c99-44bf-a687-736339857204 req-d215c887-39a9-49d0-aaf4-184d7bc0c0f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056438 Sep 15 08:59:38.637302 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 183/380] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:38.665128 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:38.665847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:38.677062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.677515 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.678472 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.678906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.762014 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:38.772949 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3a9cc401-228b-425c-9ccd-bf1d465a5711 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.373842 Sep 15 08:59:38.773503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 198/381] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:38 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:38.821099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:38.822031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:38.831122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.831681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.832596 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:38.833545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:38.960901 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:38.969671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e236268a-2148-44b3-89c2-bab6bd796cf5 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1508 microversion: 2.1 time: 0.330786 Sep 15 08:59:38.981594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 184/382] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:38 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:38.981880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-ba6914b9-4bf1-40e2-b45e-f338b2f74141 req-728dbf42-cf3d-4484-9593-7d651f1ff494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3345c950-5ef1-41b8-961a-bbab9d6fcbf7", "name": "network-vif-plugged", "status": "completed", "tag": "5b1d3897-ee7e-462d-a10b-aa48748e0837"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:38.989517 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:38.989517 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:59:39.000187 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-ba6914b9-4bf1-40e2-b45e-f338b2f74141 req-728dbf42-cf3d-4484-9593-7d651f1ff494 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.000635 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-ba6914b9-4bf1-40e2-b45e-f338b2f74141 req-728dbf42-cf3d-4484-9593-7d651f1ff494 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.022867 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-ba6914b9-4bf1-40e2-b45e-f338b2f74141 req-728dbf42-cf3d-4484-9593-7d651f1ff494 service nova] Creating event network-vif-plugged:5b1d3897-ee7e-462d-a10b-aa48748e0837 for instance 3345c950-5ef1-41b8-961a-bbab9d6fcbf7 on hv-cinder-80600 Sep 15 08:59:39.037873 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-ba6914b9-4bf1-40e2-b45e-f338b2f74141 req-728dbf42-cf3d-4484-9593-7d651f1ff494 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065508 Sep 15 08:59:39.048192 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 185/383] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:39.197849 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:39.198528 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:39.206183 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.206643 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.207410 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.207844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.378615 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:39.392371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f36af353-5fb3-48a3-b506-aff728ae7fbd tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.597300 Sep 15 08:59:39.395540 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 199/384] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:38 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:39.412491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-63dda4ac-b5cc-49d1-92cb-860806b4d047 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:39.413485 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-63dda4ac-b5cc-49d1-92cb-860806b4d047 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:39.423130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-63dda4ac-b5cc-49d1-92cb-860806b4d047 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.423644 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-63dda4ac-b5cc-49d1-92cb-860806b4d047 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.424434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-63dda4ac-b5cc-49d1-92cb-860806b4d047 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.424925 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-63dda4ac-b5cc-49d1-92cb-860806b4d047 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.526006 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:39.534947 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f181ffb5-3f10-4a21-be7d-9b9cf17faebc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.346822 Sep 15 08:59:39.535484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 186/385] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:39 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:39.545694 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d6d29bc4-b9cc-4fc7-a595-b9b4ab78d9b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:39.546667 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d6d29bc4-b9cc-4fc7-a595-b9b4ab78d9b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:39.555010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d6d29bc4-b9cc-4fc7-a595-b9b4ab78d9b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.555467 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d6d29bc4-b9cc-4fc7-a595-b9b4ab78d9b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.556367 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d6d29bc4-b9cc-4fc7-a595-b9b4ab78d9b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.556711 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d6d29bc4-b9cc-4fc7-a595-b9b4ab78d9b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.614044 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-63dda4ac-b5cc-49d1-92cb-860806b4d047 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28641 microversion: 2.1 time: 0.217085 Sep 15 08:59:39.615321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 200/386] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:39 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28641 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:39.795651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:39.796266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:39.804819 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.805264 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:39.806026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:39.806559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:40.012535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:40.020625 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-25da9df3-35f4-489d-8228-8d8ad28b213c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.235067 Sep 15 08:59:40.021142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 201/387] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:39 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:40.184468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d6d29bc4-b9cc-4fc7-a595-b9b4ab78d9b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28645 microversion: 2.20 time: 0.647731 Sep 15 08:59:40.185380 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 187/388] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:39 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28645 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:40.417132 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:40.417747 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:40.424822 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:40.425264 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:40.426029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:40.426480 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:40.558147 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:40.559309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:40.566861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:40.575400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:40.575400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:40.575400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:40.811342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:40.820813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f33c4666-247c-4915-b716-c5f19dc8c1d6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.273049 Sep 15 08:59:40.826201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 188/389] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:40 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:40.834816 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0fc2ffa9-d066-471e-8ee1-fb00c43772e2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:40.835742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0fc2ffa9-d066-471e-8ee1-fb00c43772e2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:40.845269 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0fc2ffa9-d066-471e-8ee1-fb00c43772e2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:40.845723 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0fc2ffa9-d066-471e-8ee1-fb00c43772e2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:40.846575 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0fc2ffa9-d066-471e-8ee1-fb00c43772e2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:40.847407 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0fc2ffa9-d066-471e-8ee1-fb00c43772e2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:40.866986 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:40.877841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5965a01b-6f86-4dd7-bfee-e53bad1332db tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1314 microversion: 2.1 time: 0.471585 Sep 15 08:59:40.878961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 202/390] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:40 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:41.042225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:41.043081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:41.050238 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.050829 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:41.051600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.052024 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:41.099936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0fc2ffa9-d066-471e-8ee1-fb00c43772e2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28641 microversion: 2.1 time: 0.276767 Sep 15 08:59:41.103926 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 189/391] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:40 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28641 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:41.203246 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e4cc2c55-414a-400f-8489-ef2eec5c3206 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:41.204476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e4cc2c55-414a-400f-8489-ef2eec5c3206 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:41.213398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4cc2c55-414a-400f-8489-ef2eec5c3206 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.213919 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4cc2c55-414a-400f-8489-ef2eec5c3206 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:41.214781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4cc2c55-414a-400f-8489-ef2eec5c3206 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.215280 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4cc2c55-414a-400f-8489-ef2eec5c3206 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:41.291616 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:41.299876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2c32338f-f151-4aab-8c6a-cac059ac63fe tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.266977 Sep 15 08:59:41.300625 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 203/392] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:41 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:41.514156 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e4cc2c55-414a-400f-8489-ef2eec5c3206 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 28645 microversion: 2.20 time: 0.321139 Sep 15 08:59:41.514973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 190/393] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:41 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 28645 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 08:59:41.843084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:41.843798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:41.851483 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.853365 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:41.854544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.855152 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:41.901015 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:41.901763 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:41.909963 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.910430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:41.911195 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:41.911617 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:42.079045 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:42.087305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b2dcd415-898b-46ca-b13f-9fc27dfb4556 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.253637 Sep 15 08:59:42.087836 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 204/394] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:41 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:42.119884 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-813faa30-aa49-4f8d-9e63-aa65f2413646 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:42.121248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-813faa30-aa49-4f8d-9e63-aa65f2413646 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:42.129361 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:42.130081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-813faa30-aa49-4f8d-9e63-aa65f2413646 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:42.130627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-813faa30-aa49-4f8d-9e63-aa65f2413646 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:42.131550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-813faa30-aa49-4f8d-9e63-aa65f2413646 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:42.132056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-813faa30-aa49-4f8d-9e63-aa65f2413646 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:42.140441 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-63779f43-c32b-4243-b32e-2312bf38dc98 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1498 microversion: 2.1 time: 0.248711 Sep 15 08:59:42.141428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 191/395] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:41 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:42.292280 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-813faa30-aa49-4f8d-9e63-aa65f2413646 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 28641 microversion: 2.1 time: 0.183589 Sep 15 08:59:42.292988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 205/396] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:42 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 28641 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:59:42.321694 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:42.322327 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:42.329456 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:42.329897 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:42.330687 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:42.331113 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:42.534670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-40684af5-ee52-44ec-9425-01ddd16bccea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:42.536294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-40684af5-ee52-44ec-9425-01ddd16bccea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:42.546643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40684af5-ee52-44ec-9425-01ddd16bccea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:42.546643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40684af5-ee52-44ec-9425-01ddd16bccea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:42.555727 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40684af5-ee52-44ec-9425-01ddd16bccea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:42.556212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40684af5-ee52-44ec-9425-01ddd16bccea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:42.644969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:42.653533 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-afc7b45a-16e7-4a9a-a4e6-8f8e96069e06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.340813 Sep 15 08:59:42.654066 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 192/397] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:42 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:42.747402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-40684af5-ee52-44ec-9425-01ddd16bccea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 29310 microversion: 2.20 time: 0.224203 Sep 15 08:59:42.751392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 206/398] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:42 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 29310 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:43.109724 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:43.110344 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:43.118934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.119379 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.120150 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.120575 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.310645 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8174ed38-27b9-4004-82ea-dd19aa0a25d2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:43.311849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8174ed38-27b9-4004-82ea-dd19aa0a25d2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:43.319944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8174ed38-27b9-4004-82ea-dd19aa0a25d2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.320330 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:43.320482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8174ed38-27b9-4004-82ea-dd19aa0a25d2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.321248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8174ed38-27b9-4004-82ea-dd19aa0a25d2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.321803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8174ed38-27b9-4004-82ea-dd19aa0a25d2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.328957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6f254f3e-1151-4fcb-9b29-790c85c88368 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.228544 Sep 15 08:59:43.330799 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 193/399] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:43 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:43.519766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8174ed38-27b9-4004-82ea-dd19aa0a25d2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 29546 microversion: 2.1 time: 0.219344 Sep 15 08:59:43.520651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 207/400] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:43 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 29546 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:59:43.676566 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:43.677073 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:43.684471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.684871 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.685636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.686060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.767134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a7d3fec2-16d3-452e-85f5-d1bfb36e55e9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:43.768889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a7d3fec2-16d3-452e-85f5-d1bfb36e55e9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:43.785010 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a7d3fec2-16d3-452e-85f5-d1bfb36e55e9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.785726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a7d3fec2-16d3-452e-85f5-d1bfb36e55e9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.786754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a7d3fec2-16d3-452e-85f5-d1bfb36e55e9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.787339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a7d3fec2-16d3-452e-85f5-d1bfb36e55e9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.916167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:43.924778 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ec2ed44b-3aba-4a03-8967-4276c810ec7c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.257409 Sep 15 08:59:43.934983 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 194/401] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:43 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:43.953624 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:43.954134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:43.964899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.964899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.964899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:43.964899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:43.997995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a7d3fec2-16d3-452e-85f5-d1bfb36e55e9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 30341 microversion: 2.20 time: 0.242203 Sep 15 08:59:43.998950 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 208/402] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:43 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 30341 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 08:59:44.033204 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 08:59:44.325558 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-31404bd7-d39b-4894-aefc-fcafe3f1381e tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 204 len: 0 microversion: 2.1 time: 0.398563 Sep 15 08:59:44.328426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 195/403] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 08:59:43 2021] DELETE /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 08:59:44.341188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:44.341882 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:44.350745 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.351197 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:44.352788 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:44.353227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.353340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:44.353438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:44.359649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.360326 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:44.361264 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.361686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:44.595226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:44.609974 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2798721b-b03a-4084-9134-d247dc632171 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1504 microversion: 2.1 time: 0.279274 Sep 15 08:59:44.614330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 209/404] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:44 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:44.633508 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:44.637962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-084606cc-81af-4d04-ad43-aa6715397843 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:44.644000 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-084606cc-81af-4d04-ad43-aa6715397843 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:44.650906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-deaee4ee-f6a3-4994-a779-007473f5bafc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.308873 Sep 15 08:59:44.656708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 196/405] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:44 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:44.658041 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-084606cc-81af-4d04-ad43-aa6715397843 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.658520 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-084606cc-81af-4d04-ad43-aa6715397843 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:44.659301 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-084606cc-81af-4d04-ad43-aa6715397843 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.659728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-084606cc-81af-4d04-ad43-aa6715397843 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:44.840139 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-084606cc-81af-4d04-ad43-aa6715397843 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 30723 microversion: 2.1 time: 0.223350 Sep 15 08:59:44.840988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 210/406] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:44 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 30723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:44.946151 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:44.946750 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:44.954019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.954551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:44.955304 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:44.955725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.031625 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-874ab21b-4cdb-4319-9063-7c789499f7e6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:45.032691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-874ab21b-4cdb-4319-9063-7c789499f7e6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:45.042005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-874ab21b-4cdb-4319-9063-7c789499f7e6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.042500 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-874ab21b-4cdb-4319-9063-7c789499f7e6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.043269 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-874ab21b-4cdb-4319-9063-7c789499f7e6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.043750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-874ab21b-4cdb-4319-9063-7c789499f7e6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.288198 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-874ab21b-4cdb-4319-9063-7c789499f7e6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 31224 microversion: 2.20 time: 0.282775 Sep 15 08:59:45.289007 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 211/407] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:45 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 31224 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 08:59:45.422795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:45.430936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-239bad1c-bd64-4b50-a496-c1b711dd12a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.494071 Sep 15 08:59:45.436519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 197/408] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:44 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:45.638772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:45.640215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:45.649341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.650161 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.651151 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.651789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.677256 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:45.677922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:45.691741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.692189 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.701393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.702006 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.920991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:45.931675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d7f7ed91-27d3-4ca6-9644-aae9cd38b60c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1504 microversion: 2.1 time: 0.303327 Sep 15 08:59:45.932225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 212/409] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:45 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:45.955767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f7f99707-f2ab-4bf8-bf7a-09d24d1bfab8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:45.956702 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f7f99707-f2ab-4bf8-bf7a-09d24d1bfab8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:45.967457 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7f99707-f2ab-4bf8-bf7a-09d24d1bfab8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.967457 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7f99707-f2ab-4bf8-bf7a-09d24d1bfab8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:45.968099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7f99707-f2ab-4bf8-bf7a-09d24d1bfab8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:45.968499 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7f99707-f2ab-4bf8-bf7a-09d24d1bfab8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:46.030114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:46.039328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a9b62ad4-d7e2-4097-90b0-e053f3c94b4c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.374281 Sep 15 08:59:46.039949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 198/410] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:45 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:46.166482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f7f99707-f2ab-4bf8-bf7a-09d24d1bfab8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 31591 microversion: 2.1 time: 0.232775 Sep 15 08:59:46.167728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 213/411] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:45 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 31591 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:46.311225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d890a978-69de-4978-a659-240d4425c44a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:46.312210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d890a978-69de-4978-a659-240d4425c44a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:46.319296 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d890a978-69de-4978-a659-240d4425c44a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:46.319733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d890a978-69de-4978-a659-240d4425c44a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:46.320652 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d890a978-69de-4978-a659-240d4425c44a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:46.321387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d890a978-69de-4978-a659-240d4425c44a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:46.453470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:46.458355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:46.466703 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:46.467148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:46.467929 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:46.468369 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:46.493137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d890a978-69de-4978-a659-240d4425c44a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 32118 microversion: 2.20 time: 0.195739 Sep 15 08:59:46.494404 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 199/412] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:46 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 32118 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:46.694069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:46.700694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-40398bcd-9206-47d7-839a-da3a28ed0a68 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.257419 Sep 15 08:59:46.701387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 214/413] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:46 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:46.957349 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:46.958330 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:46.967300 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:46.967817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:46.968894 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:46.969303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.061259 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:47.061855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:47.079577 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.080237 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.083056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.083658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.272878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:47.283875 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3ba30d54-4340-4073-9660-0c322aac398d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1504 microversion: 2.1 time: 0.338334 Sep 15 08:59:47.285210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 200/414] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:46 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:47.297562 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-54af9ecb-6320-4cb4-b1a8-1608961a5140 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:47.298784 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-54af9ecb-6320-4cb4-b1a8-1608961a5140 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:47.308164 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-54af9ecb-6320-4cb4-b1a8-1608961a5140 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.309079 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-54af9ecb-6320-4cb4-b1a8-1608961a5140 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.310015 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-54af9ecb-6320-4cb4-b1a8-1608961a5140 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.310782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-54af9ecb-6320-4cb4-b1a8-1608961a5140 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.501562 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-54af9ecb-6320-4cb4-b1a8-1608961a5140 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 32381 microversion: 2.1 time: 0.214852 Sep 15 08:59:47.502449 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 201/415] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:47 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 32381 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:47.513639 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-21bd2129-b826-4bb4-b7c9-ff4f0abb6c44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:47.514657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-21bd2129-b826-4bb4-b7c9-ff4f0abb6c44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:47.522800 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21bd2129-b826-4bb4-b7c9-ff4f0abb6c44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.523244 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21bd2129-b826-4bb4-b7c9-ff4f0abb6c44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.524033 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21bd2129-b826-4bb4-b7c9-ff4f0abb6c44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.524648 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-21bd2129-b826-4bb4-b7c9-ff4f0abb6c44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.610970 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:47.621289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ee357526-e6c5-4348-ba79-220c1cfcd245 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.568179 Sep 15 08:59:47.623056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 215/416] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:47 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:47.696265 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-21bd2129-b826-4bb4-b7c9-ff4f0abb6c44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 32857 microversion: 2.20 time: 0.191464 Sep 15 08:59:47.700801 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 202/417] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:47 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 32857 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:47.725889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:47.726562 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:47.734143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.739465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:47.739465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:47.739465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.152385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:48.161416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8481b0e4-e02c-4ee8-93a0-987a8466e23a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.448284 Sep 15 08:59:48.162469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 216/418] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:47 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:48.306714 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:48.307474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:48.315205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.315638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.316390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.316808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.352277 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-b6acddba-1349-4b3e-99aa-9ac6a0c9dbba req-86d5cb62-8afc-46da-8d61-b5e728c267a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3345c950-5ef1-41b8-961a-bbab9d6fcbf7", "name": "network-vif-deleted", "tag": "5b1d3897-ee7e-462d-a10b-aa48748e0837"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:48.361142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:48.361142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:59:48.369715 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-b6acddba-1349-4b3e-99aa-9ac6a0c9dbba req-86d5cb62-8afc-46da-8d61-b5e728c267a6 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.370215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-b6acddba-1349-4b3e-99aa-9ac6a0c9dbba req-86d5cb62-8afc-46da-8d61-b5e728c267a6 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.386783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-b6acddba-1349-4b3e-99aa-9ac6a0c9dbba req-86d5cb62-8afc-46da-8d61-b5e728c267a6 service nova] Creating event network-vif-deleted:5b1d3897-ee7e-462d-a10b-aa48748e0837 for instance 3345c950-5ef1-41b8-961a-bbab9d6fcbf7 on hv-cinder-80600 Sep 15 08:59:48.391758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-b6acddba-1349-4b3e-99aa-9ac6a0c9dbba req-86d5cb62-8afc-46da-8d61-b5e728c267a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052785 Sep 15 08:59:48.392503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 217/419] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:59:48.444043 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:48.452703 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9bd27856-4304-4746-a918-64d97226d7f0 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1462 microversion: 2.1 time: 0.155525 Sep 15 08:59:48.453251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 203/420] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:48 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1462 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:48.519701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-522d1be7-0bc5-4713-a938-6a0d6e0bbe97 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:48.523306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-522d1be7-0bc5-4713-a938-6a0d6e0bbe97 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:48.534348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-522d1be7-0bc5-4713-a938-6a0d6e0bbe97 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.534348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-522d1be7-0bc5-4713-a938-6a0d6e0bbe97 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.534705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-522d1be7-0bc5-4713-a938-6a0d6e0bbe97 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.535099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-522d1be7-0bc5-4713-a938-6a0d6e0bbe97 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.645661 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:48.646287 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:48.654148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.654610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.655403 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.655831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.693375 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-522d1be7-0bc5-4713-a938-6a0d6e0bbe97 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 33038 microversion: 2.1 time: 0.183604 Sep 15 08:59:48.698179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 218/421] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:48 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 33038 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:48.720560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-657cb075-9695-4d3d-addf-89069f0199f2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:48.722048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-657cb075-9695-4d3d-addf-89069f0199f2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:48.732978 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-657cb075-9695-4d3d-addf-89069f0199f2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.733544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-657cb075-9695-4d3d-addf-89069f0199f2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.734426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-657cb075-9695-4d3d-addf-89069f0199f2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.734947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-657cb075-9695-4d3d-addf-89069f0199f2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.884084 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:48.900508 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8b6e38e7-72eb-45fb-ab98-6b122e62a656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.264150 Sep 15 08:59:48.901300 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 204/422] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:48 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:48.927145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-3e82ee95-62d9-4983-8d34-26a0ac0a74ad req-8bcfbbcf-c8ee-4509-87a9-e4a476c49131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50af7e90-3b57-4e95-97b0-e298f753c007", "name": "network-vif-plugged", "status": "completed", "tag": "940aa7fc-de3e-46ed-ae69-062a759e8fdc"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:48.934080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:48.934080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:59:48.942111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-3e82ee95-62d9-4983-8d34-26a0ac0a74ad req-8bcfbbcf-c8ee-4509-87a9-e4a476c49131 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:48.942563 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-3e82ee95-62d9-4983-8d34-26a0ac0a74ad req-8bcfbbcf-c8ee-4509-87a9-e4a476c49131 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:48.948503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-657cb075-9695-4d3d-addf-89069f0199f2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 33301 microversion: 2.20 time: 0.243335 Sep 15 08:59:48.949140 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 219/423] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:48 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 33301 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:48.959529 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-3e82ee95-62d9-4983-8d34-26a0ac0a74ad req-8bcfbbcf-c8ee-4509-87a9-e4a476c49131 service nova] Creating event network-vif-plugged:940aa7fc-de3e-46ed-ae69-062a759e8fdc for instance 50af7e90-3b57-4e95-97b0-e298f753c007 on hv-cinder-80600 Sep 15 08:59:48.964166 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-3e82ee95-62d9-4983-8d34-26a0ac0a74ad req-8bcfbbcf-c8ee-4509-87a9-e4a476c49131 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046035 Sep 15 08:59:48.970276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 205/424] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 08:59:49.185989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:49.186717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:49.194671 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.195119 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.196639 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.197081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.197698 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-754577188", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:49.266767 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] validate_networks() for None {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:59:49.421310 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:49.429321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bfde0f7c-2ee2-4f24-85a1-a559c98ee1d1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.253919 Sep 15 08:59:49.430419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 220/425] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:49 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:49.478714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:49.479347 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:49.486806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.492059 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.492059 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.492059 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.559058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:59:49.559780 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:59:49.560614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:59:49.561283 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:59:49.561963 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:59:49.571344 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.571939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.572633 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lazy-loading 'fault' on Instance uuid 3345c950-5ef1-41b8-961a-bbab9d6fcbf7 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 08:59:49.573778 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.574782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.578264 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.578264 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.602037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Getting quotas for project 72b6343f1c844d948bcc8ac62e2214b7. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:59:49.602037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Getting quotas for user 19c381af2e6b4821827d5e52d702e418 and project 72b6343f1c844d948bcc8ac62e2214b7. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:59:49.612445 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:59:49.614905 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:59:49.727090 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:49.735253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-112da9df-bb94-423f-bcab-3179265f36ed tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 200 len: 1304 microversion: 2.1 time: 0.268538 Sep 15 08:59:49.745336 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 221/426] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:49 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 1304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:49.746149 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-307d6cf4-7d7b-44e6-a16e-a66730b29e7d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:49.747368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-307d6cf4-7d7b-44e6-a16e-a66730b29e7d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:49.761999 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-66bc5661-f890-4f3e-a6b7-ed92ef93b1a4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574811 Sep 15 08:59:49.763232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 206/427] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:59:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 08:59:49.784795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f347653f-865e-460e-a576-d2374b1edcd4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:49.786811 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f347653f-865e-460e-a576-d2374b1edcd4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:49.872299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f347653f-865e-460e-a576-d2374b1edcd4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:49.884433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f347653f-865e-460e-a576-d2374b1edcd4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1214 microversion: 2.1 time: 0.113250 Sep 15 08:59:49.885070 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 207/428] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:49 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:49.905211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-307d6cf4-7d7b-44e6-a16e-a66730b29e7d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.905658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-307d6cf4-7d7b-44e6-a16e-a66730b29e7d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.906494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-307d6cf4-7d7b-44e6-a16e-a66730b29e7d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.906883 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-307d6cf4-7d7b-44e6-a16e-a66730b29e7d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.924220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:49.924826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:49.932500 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.932942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:49.934294 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:49.934738 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.143510 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:50.152886 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8b5419e1-3ab4-4760-bcf9-216277fc4005 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.239822 Sep 15 08:59:50.153921 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 208/429] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:49 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:50.170982 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c62af213-8a07-4362-904d-f9fadf839b27 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:50.172099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c62af213-8a07-4362-904d-f9fadf839b27 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:50.179718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c62af213-8a07-4362-904d-f9fadf839b27 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.180101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c62af213-8a07-4362-904d-f9fadf839b27 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.181327 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c62af213-8a07-4362-904d-f9fadf839b27 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.181757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c62af213-8a07-4362-904d-f9fadf839b27 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.220547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-307d6cf4-7d7b-44e6-a16e-a66730b29e7d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 33487 microversion: 2.1 time: 0.483160 Sep 15 08:59:50.225225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 222/430] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:49 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 33487 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:50.335555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c62af213-8a07-4362-904d-f9fadf839b27 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 33778 microversion: 2.20 time: 0.180218 Sep 15 08:59:50.340294 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 209/431] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:50 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 33778 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:50.453809 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:50.454678 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:50.462669 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.463163 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.463966 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.464387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.668945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:50.676943 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9c1c8e20-6b44-434c-8314-37c2a13ccf8c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1317 microversion: 2.1 time: 0.233597 Sep 15 08:59:50.677486 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 223/432] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:50 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:50.759206 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:50.759892 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: 3345c950-5ef1-41b8-961a-bbab9d6fcbf7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:50.767889 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.768439 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.769075 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.769540 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.818793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] HTTP exception thrown: Instance 3345c950-5ef1-41b8-961a-bbab9d6fcbf7 could not be found. Sep 15 08:59:50.819387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Returning 404 to user: Instance 3345c950-5ef1-41b8-961a-bbab9d6fcbf7 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 08:59:50.820207 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7d4953f1-f147-4200-8c39-d41f0bdd169c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7" status: 404 len: 111 microversion: 2.1 time: 0.071306 Sep 15 08:59:50.820754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 210/433] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:50 2021] GET /compute/v2.1/servers/3345c950-5ef1-41b8-961a-bbab9d6fcbf7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 08:59:50.907362 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:50.908057 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:50.915782 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.916238 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.917072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:50.917842 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:50.937541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-354710159", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "63e0e726-1b2c-492a-a326-ad06482c3cf5"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:51.012424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] validate_networks() for [('63e0e726-1b2c-492a-a326-ad06482c3cf5', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 08:59:51.045949 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:51.053970 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1cfdd38d-c865-441b-bfa3-828d28ed5301 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1218 microversion: 2.1 time: 0.157042 Sep 15 08:59:51.055171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 224/434] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:50 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:51.177008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:51.177634 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:51.185012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.185490 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.186287 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.186749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.406058 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:51.415205 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-03b9fba9-3d5d-42bf-9a88-ee9baa1673c9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.249350 Sep 15 08:59:51.416058 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 225/435] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:51 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:51.427483 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4607a4ef-8b79-4a21-8675-062914601932 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:51.428487 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4607a4ef-8b79-4a21-8675-062914601932 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:51.436242 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4607a4ef-8b79-4a21-8675-062914601932 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.439861 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4607a4ef-8b79-4a21-8675-062914601932 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.440911 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4607a4ef-8b79-4a21-8675-062914601932 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.441355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4607a4ef-8b79-4a21-8675-062914601932 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.537882 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 08:59:51.538324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 08:59:51.538842 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 08:59:51.539310 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 08:59:51.539716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 08:59:51.548891 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.549331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.550147 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.550580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.568746 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Getting quotas for project 8bd1284f0069453d9dc1923926636b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 08:59:51.573303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Getting quotas for user 35dc7acffefb4404af415ceaac2283f4 and project 8bd1284f0069453d9dc1923926636b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 08:59:51.584263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 08:59:51.587340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 08:59:51.629727 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4607a4ef-8b79-4a21-8675-062914601932 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 33956 microversion: 2.1 time: 0.212133 Sep 15 08:59:51.630393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 226/436] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:51 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 33956 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:51.641341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cfc94211-ced8-4669-a991-e6953440b91c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:51.642362 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cfc94211-ced8-4669-a991-e6953440b91c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:51.650676 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cfc94211-ced8-4669-a991-e6953440b91c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.651113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cfc94211-ced8-4669-a991-e6953440b91c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.651872 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cfc94211-ced8-4669-a991-e6953440b91c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.652302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cfc94211-ced8-4669-a991-e6953440b91c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.734755 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ea5abe89-8986-4d5c-b8cd-9f1fcba639bb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806223 Sep 15 08:59:51.735973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 211/437] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 08:59:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 08:59:51.746583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:51.747184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:51.755983 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.756450 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.757211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:51.758438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:51.838811 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cfc94211-ced8-4669-a991-e6953440b91c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 34272 microversion: 2.20 time: 0.206778 Sep 15 08:59:51.845233 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 227/438] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:51 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 34272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:51.860191 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0b4fa9cc-8aa0-4648-a4c0-7b6fea705248 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:51.866780 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0b4fa9cc-8aa0-4648-a4c0-7b6fea705248 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:51.949045 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0b4fa9cc-8aa0-4648-a4c0-7b6fea705248 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:51.956409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0b4fa9cc-8aa0-4648-a4c0-7b6fea705248 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1213 microversion: 2.1 time: 0.109349 Sep 15 08:59:51.956938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 228/439] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:51 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:51.994561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:52.002542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-26f17fdb-37ec-434c-bd07-48aa717e0a41 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1506 microversion: 2.1 time: 0.265679 Sep 15 08:59:52.003044 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 212/440] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:51 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:52.076248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:52.076998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:52.085856 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.092330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.092330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.092330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.223909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:52.232055 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b08da01b-cd19-43bf-be9b-b33b3d4e0d31 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1266 microversion: 2.1 time: 0.165862 Sep 15 08:59:52.232721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 229/441] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:52 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:52.437835 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:52.438491 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:52.445769 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.446248 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.447008 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.447432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.661177 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b33916d2-4881-450e-92d2-e2619600179a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:52.662559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b33916d2-4881-450e-92d2-e2619600179a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:52.675762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b33916d2-4881-450e-92d2-e2619600179a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.676208 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b33916d2-4881-450e-92d2-e2619600179a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.689029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b33916d2-4881-450e-92d2-e2619600179a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.689581 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b33916d2-4881-450e-92d2-e2619600179a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.692877 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:52.701240 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3a4800ab-e9b2-4022-8eaa-e9bb39bc6e2d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.272955 Sep 15 08:59:52.711209 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 213/442] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:52 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:52.860496 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-426175b3-a316-424b-b1c6-52a2a06ba2cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:52.863719 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-426175b3-a316-424b-b1c6-52a2a06ba2cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:52.879718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-426175b3-a316-424b-b1c6-52a2a06ba2cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.879855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-426175b3-a316-424b-b1c6-52a2a06ba2cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.883986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-426175b3-a316-424b-b1c6-52a2a06ba2cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.884132 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b33916d2-4881-450e-92d2-e2619600179a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 34726 microversion: 2.1 time: 0.245082 Sep 15 08:59:52.884617 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-426175b3-a316-424b-b1c6-52a2a06ba2cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.885233 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 230/443] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:52 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 34726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:59:52.984032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:52.985678 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:52.997373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.998045 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:52.999229 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:52.999915 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:53.101923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-426175b3-a316-424b-b1c6-52a2a06ba2cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 35071 microversion: 2.20 time: 0.253913 Sep 15 08:59:53.107094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 214/444] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:52 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 35071 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:53.251402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:53.254931 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:53.255634 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:53.261672 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ef532c70-b5dc-42ec-9f8f-7872cf81e548 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1217 microversion: 2.1 time: 0.292593 Sep 15 08:59:53.263539 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 231/445] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:52 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:53.264526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:53.264957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:53.265945 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:53.266404 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:53.391756 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:53.400202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c467a736-f6b9-43b5-967c-181de0f734b9 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1272 microversion: 2.1 time: 0.155228 Sep 15 08:59:53.400725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 215/446] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:53 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:53.723605 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:53.724209 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:53.731620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:53.732070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:53.732851 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:53.733281 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:53.902383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-856064bd-9cdb-40f9-a42d-d3610f92129f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:53.903306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-856064bd-9cdb-40f9-a42d-d3610f92129f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:53.911060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856064bd-9cdb-40f9-a42d-d3610f92129f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:53.911499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856064bd-9cdb-40f9-a42d-d3610f92129f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:53.912484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856064bd-9cdb-40f9-a42d-d3610f92129f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:53.912908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856064bd-9cdb-40f9-a42d-d3610f92129f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:53.998931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:54.007815 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-86d6d9e3-cc38-41a4-afee-53aaa502e118 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.293815 Sep 15 08:59:54.008332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 232/447] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:53 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:54.081441 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-856064bd-9cdb-40f9-a42d-d3610f92129f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 35318 microversion: 2.1 time: 0.189211 Sep 15 08:59:54.085931 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 216/448] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:53 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 35318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:54.143905 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-194ffcb9-485c-4c55-8788-0b62ff7bd280 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:54.145996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-194ffcb9-485c-4c55-8788-0b62ff7bd280 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:54.176515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-194ffcb9-485c-4c55-8788-0b62ff7bd280 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:54.176515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-194ffcb9-485c-4c55-8788-0b62ff7bd280 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:54.176515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-194ffcb9-485c-4c55-8788-0b62ff7bd280 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:54.176515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-194ffcb9-485c-4c55-8788-0b62ff7bd280 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:54.300733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:54.300733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:54.308126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:54.308502 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:54.309237 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:54.309667 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:54.369228 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-194ffcb9-485c-4c55-8788-0b62ff7bd280 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 35610 microversion: 2.20 time: 0.256788 Sep 15 08:59:54.370195 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 233/449] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:54 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 35610 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:54.425867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:54.427185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:54.452217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:54.456937 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:54.459367 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:54.461760 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:54.568398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:54.584324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fb8d2fac-eccf-4847-a1f4-7dcc1cc9bee8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1265 microversion: 2.1 time: 0.309404 Sep 15 08:59:54.590208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 217/450] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:54 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:55.032169 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:55.032856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:55.040636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.041222 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.042056 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.042513 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.175313 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:55.202115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9622ad40-8384-48ed-835c-59d900e554d4 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.787792 Sep 15 08:59:55.217058 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 234/451] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:54 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:55.240737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9a06b2ea-194e-47a8-8691-4e25dc6720b7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:55.256651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9a06b2ea-194e-47a8-8691-4e25dc6720b7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:55.278551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a06b2ea-194e-47a8-8691-4e25dc6720b7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.280129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a06b2ea-194e-47a8-8691-4e25dc6720b7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.282491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a06b2ea-194e-47a8-8691-4e25dc6720b7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.284253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a06b2ea-194e-47a8-8691-4e25dc6720b7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.502544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9a06b2ea-194e-47a8-8691-4e25dc6720b7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 36375 microversion: 2.1 time: 0.283379 Sep 15 08:59:55.506733 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 235/452] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:55 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 36375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:55.519410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b7e47867-addb-41c1-a8d0-ce2daa42e61d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:55.521084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b7e47867-addb-41c1-a8d0-ce2daa42e61d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:55.533827 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b7e47867-addb-41c1-a8d0-ce2daa42e61d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.534603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b7e47867-addb-41c1-a8d0-ce2daa42e61d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.535096 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b7e47867-addb-41c1-a8d0-ce2daa42e61d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.535557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b7e47867-addb-41c1-a8d0-ce2daa42e61d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.575838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:55.585210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0a6613fc-4229-4531-a455-9f960e430b39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.562428 Sep 15 08:59:55.586433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 218/453] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:55 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:55.597638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-592d363e-74dc-49ca-a716-839ae4da7ba0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6724d9af-fd27-4e00-b972-8ad239a6b494"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:55.598824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-592d363e-74dc-49ca-a716-839ae4da7ba0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:55.610837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592d363e-74dc-49ca-a716-839ae4da7ba0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.611274 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592d363e-74dc-49ca-a716-839ae4da7ba0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.612044 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592d363e-74dc-49ca-a716-839ae4da7ba0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.612468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592d363e-74dc-49ca-a716-839ae4da7ba0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.737826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b7e47867-addb-41c1-a8d0-ce2daa42e61d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 36563 microversion: 2.20 time: 0.232950 Sep 15 08:59:55.738771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 236/454] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:55 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 36563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:55.756442 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:55.756442 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:55.767531 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.768379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.769197 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:55.769632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:55.979472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:55.990659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dda74117-ef26-4972-b5d8-7eb2880bb63a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1271 microversion: 2.1 time: 0.250272 Sep 15 08:59:55.992432 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 237/455] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:55 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:56.005120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-d01ecb40-d60c-497f-959e-ef9399a37b0e req-7c307dc0-de62-4065-86c9-fef4803f251d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ab441b-e63b-43fe-9379-802feabe79af", "tag": "88421ab9-f482-4ad4-9055-bff29835d130"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:56.014880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:56.014880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 08:59:56.023931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-d01ecb40-d60c-497f-959e-ef9399a37b0e req-7c307dc0-de62-4065-86c9-fef4803f251d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.024459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-d01ecb40-d60c-497f-959e-ef9399a37b0e req-7c307dc0-de62-4065-86c9-fef4803f251d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.043033 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-d01ecb40-d60c-497f-959e-ef9399a37b0e req-7c307dc0-de62-4065-86c9-fef4803f251d service nova] Creating event network-changed:88421ab9-f482-4ad4-9055-bff29835d130 for instance 72ab441b-e63b-43fe-9379-802feabe79af on hv-cinder-80600 Sep 15 08:59:56.048906 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-d01ecb40-d60c-497f-959e-ef9399a37b0e req-7c307dc0-de62-4065-86c9-fef4803f251d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054940 Sep 15 08:59:56.049506 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 238/456] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:56.226409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:56.230497 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:56.234836 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.235307 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.236279 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.236714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.601269 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:56.610766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-51cfc9e4-6906-466b-9735-518d8c171ff7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.394147 Sep 15 08:59:56.611398 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 239/457] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:56 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:56.623028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4b064c0e-1875-4269-ac39-dc5abbb887f5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:56.624047 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4b064c0e-1875-4269-ac39-dc5abbb887f5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:56.631589 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4b064c0e-1875-4269-ac39-dc5abbb887f5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.632062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4b064c0e-1875-4269-ac39-dc5abbb887f5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.633558 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4b064c0e-1875-4269-ac39-dc5abbb887f5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.633976 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4b064c0e-1875-4269-ac39-dc5abbb887f5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.702942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-592d363e-74dc-49ca-a716-839ae4da7ba0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114464 Sep 15 08:59:56.703938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 219/458] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 08:59:55 2021] POST /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:56.718959 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:56.720363 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:56.733123 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.734231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.736053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.736756 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.850337 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4b064c0e-1875-4269-ac39-dc5abbb887f5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 37027 microversion: 2.1 time: 0.237294 Sep 15 08:59:56.854936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 240/459] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:56 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 37027 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 08:59:56.871344 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-276102ee-30da-47d5-a161-527b24a12eac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:56.872388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-276102ee-30da-47d5-a161-527b24a12eac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:56.882784 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-276102ee-30da-47d5-a161-527b24a12eac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.883586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-276102ee-30da-47d5-a161-527b24a12eac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:56.884796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-276102ee-30da-47d5-a161-527b24a12eac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:56.885461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-276102ee-30da-47d5-a161-527b24a12eac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.015772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:57.024276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d9e1a994-6bde-4c6b-91e2-0e2bc8b175cf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.319043 Sep 15 08:59:57.024901 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 220/460] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:56 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:57.034719 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:57.035312 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:57.043093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:57.043507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.044261 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:57.044798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.208837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-276102ee-30da-47d5-a161-527b24a12eac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 37535 microversion: 2.20 time: 0.355663 Sep 15 08:59:57.210120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 241/461] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:56 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 37535 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:57.635359 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:57.636659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:57.637363 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:57.645318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:57.646037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.646177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-84964bad-b781-4199-aae9-0a825a09b0a8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.620170 Sep 15 08:59:57.647096 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:57.647688 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.656574 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 221/462] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:57 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:57.778266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-1e2415de-e444-4e4b-809d-8e1b5463a142 req-e7aeecc4-103c-48c0-8acd-b563754ee67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8493648-d1a6-4d4d-bceb-4513f9bcb75f", "tag": "46a75e53-1878-499f-89c2-34e2b09778a8"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:57.785468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 08:59:57.785468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 08:59:57.797965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-1e2415de-e444-4e4b-809d-8e1b5463a142 req-e7aeecc4-103c-48c0-8acd-b563754ee67f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:57.798791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-1e2415de-e444-4e4b-809d-8e1b5463a142 req-e7aeecc4-103c-48c0-8acd-b563754ee67f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.815698 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-1e2415de-e444-4e4b-809d-8e1b5463a142 req-e7aeecc4-103c-48c0-8acd-b563754ee67f service nova] Creating event network-changed:46a75e53-1878-499f-89c2-34e2b09778a8 for instance f8493648-d1a6-4d4d-bceb-4513f9bcb75f on hv-cinder-80600 Sep 15 08:59:57.822668 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-1e2415de-e444-4e4b-809d-8e1b5463a142 req-e7aeecc4-103c-48c0-8acd-b563754ee67f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055906 Sep 15 08:59:57.825397 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 222/463] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 08:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 08:59:57.869637 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6b26dd39-dbfe-479c-883f-a71b2796608c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:57.870675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6b26dd39-dbfe-479c-883f-a71b2796608c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:57.878853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b26dd39-dbfe-479c-883f-a71b2796608c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:57.879306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b26dd39-dbfe-479c-883f-a71b2796608c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.880077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b26dd39-dbfe-479c-883f-a71b2796608c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:57.880510 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b26dd39-dbfe-479c-883f-a71b2796608c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:57.918443 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:57.926540 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-db2e6d45-24d3-468a-9951-8c3f490353cb tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.300927 Sep 15 08:59:57.927182 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 242/464] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:57 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:58.049304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:58.056081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:58.057741 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.058220 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.058996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.059422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.333318 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6b26dd39-dbfe-479c-883f-a71b2796608c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 37831 microversion: 2.1 time: 0.474078 Sep 15 08:59:58.337731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 223/465] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:57 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 37831 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:59:58.345138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:58.348594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-02ac642e-6eae-4d46-91a5-7e366e6d9a79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:58.353028 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-02ac642e-6eae-4d46-91a5-7e366e6d9a79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:58.356975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2fae1d8a-618c-43c2-89ca-ab7f990f051b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.319455 Sep 15 08:59:58.359127 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 243/466] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:58 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:58.374923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02ac642e-6eae-4d46-91a5-7e366e6d9a79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.375576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02ac642e-6eae-4d46-91a5-7e366e6d9a79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.381942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02ac642e-6eae-4d46-91a5-7e366e6d9a79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.381942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02ac642e-6eae-4d46-91a5-7e366e6d9a79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.622140 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-02ac642e-6eae-4d46-91a5-7e366e6d9a79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 38148 microversion: 2.20 time: 0.282866 Sep 15 08:59:58.623039 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 224/467] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:58 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 38148 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:58.669806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:58.670385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:58.678257 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.678694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.679482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.679904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.950438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:58.952671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:58.956923 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:58.959595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.960045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.961481 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:58.961915 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:58.966118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-235c3b64-a753-4d18-a7a6-dd526858dec4 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.306339 Sep 15 08:59:58.977075 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 244/468] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:58 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:59.350875 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ba253ba8-7d48-4187-afca-450e31e6b49f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:59.352156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ba253ba8-7d48-4187-afca-450e31e6b49f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:59.359800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ba253ba8-7d48-4187-afca-450e31e6b49f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:59.360399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ba253ba8-7d48-4187-afca-450e31e6b49f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:59.364431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ba253ba8-7d48-4187-afca-450e31e6b49f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:59.364431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ba253ba8-7d48-4187-afca-450e31e6b49f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:59.379669 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:59.392059 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ec405bf6-b54a-43ce-8e0b-737e6ee73e25 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.451690 Sep 15 08:59:59.401662 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 225/469] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:58 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 08:59:59.407202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:59.407820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:59.416023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:59.416526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:59.417322 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:59.417762 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:59.697594 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ba253ba8-7d48-4187-afca-450e31e6b49f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 38062 microversion: 2.1 time: 0.356161 Sep 15 08:59:59.702062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 245/470] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 08:59:59 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 38062 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 08:59:59.709444 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a8635fd7-3bd6-450c-8e25-1a53047e0dd6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 08:59:59.723679 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a8635fd7-3bd6-450c-8e25-1a53047e0dd6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 08:59:59.734187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8635fd7-3bd6-450c-8e25-1a53047e0dd6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:59.736522 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8635fd7-3bd6-450c-8e25-1a53047e0dd6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:59.736522 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8635fd7-3bd6-450c-8e25-1a53047e0dd6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 08:59:59.736522 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8635fd7-3bd6-450c-8e25-1a53047e0dd6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 08:59:59.753197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 08:59:59.762614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-649f2105-3826-4520-b188-21c8fdec32d0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.368238 Sep 15 08:59:59.763267 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 226/471] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:59 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 08:59:59.975012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a8635fd7-3bd6-450c-8e25-1a53047e0dd6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 200 len: 38288 microversion: 2.20 time: 0.275049 Sep 15 08:59:59.975720 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 246/472] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 08:59:59 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 38288 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 08:59:59.998529 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 08:59:59.999168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:00.002325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0bf875b6-ef90-466b-a769-f295f3816407 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:00.002902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0bf875b6-ef90-466b-a769-f295f3816407 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:00.008864 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.009299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.010303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.010887 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.011008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0bf875b6-ef90-466b-a769-f295f3816407 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.011405 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0bf875b6-ef90-466b-a769-f295f3816407 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.012373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0bf875b6-ef90-466b-a769-f295f3816407 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.013065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0bf875b6-ef90-466b-a769-f295f3816407 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.078450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0bf875b6-ef90-466b-a769-f295f3816407 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/ips" status: 200 len: 151 microversion: 2.20 time: 0.090747 Sep 15 09:00:00.084314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 247/473] 10.222.0.39 () {60 vars in 1289 bytes} [Wed Sep 15 08:59:59 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:00:00.315445 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:00.323769 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3c7bcfa0-8d0c-4cab-bdc5-a8209dadb6a2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.343656 Sep 15 09:00:00.333439 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 227/474] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 08:59:59 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:00.414636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:00.415226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:00.425407 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.426201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.427022 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.427455 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.645695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:00.655044 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0b998441-d203-44e3-93c4-11fdd6371ed6 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.250131 Sep 15 09:00:00.670378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 248/475] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:00 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:00.714476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6713e2c7-71f0-457b-9a26-9f3591382b07 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:00.715740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6713e2c7-71f0-457b-9a26-9f3591382b07 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:00.723269 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6713e2c7-71f0-457b-9a26-9f3591382b07 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.723915 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6713e2c7-71f0-457b-9a26-9f3591382b07 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.724844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6713e2c7-71f0-457b-9a26-9f3591382b07 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.725424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6713e2c7-71f0-457b-9a26-9f3591382b07 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.785422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:00.786029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:00.793427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.793950 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.794800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.795227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.915826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6713e2c7-71f0-457b-9a26-9f3591382b07 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 200 len: 38191 microversion: 2.1 time: 0.210666 Sep 15 09:00:00.921736 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 228/476] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:00:00 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 38191 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:00:00.933726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6c57effc-6e57-45a6-95ec-de9918235ce8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:00.934344 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6c57effc-6e57-45a6-95ec-de9918235ce8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:00.942336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6c57effc-6e57-45a6-95ec-de9918235ce8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.942783 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6c57effc-6e57-45a6-95ec-de9918235ce8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:00.943874 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6c57effc-6e57-45a6-95ec-de9918235ce8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:00.944061 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6c57effc-6e57-45a6-95ec-de9918235ce8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.011489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6c57effc-6e57-45a6-95ec-de9918235ce8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/ips" status: 200 len: 147 microversion: 2.1 time: 0.088104 Sep 15 09:00:01.012420 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 229/477] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Sep 15 09:00:00 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/ips => generated 147 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:01.020723 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:01.030479 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ab21c9a2-e0a8-4134-a4a0-dbf3af194782 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1501 microversion: 2.1 time: 0.254190 Sep 15 09:00:01.031304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 249/478] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:00 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:01.051741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a5b4c4d-20ef-4318-900a-d52d8e7c3cd9"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:01.052949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:01.061016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.061532 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.062413 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.062922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.128940 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] HTTP exception thrown: Cannot 'attach_volume' instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 while it is in vm_state rescued Sep 15 09:00:01.133354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Returning 409 to user: Cannot 'attach_volume' instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 while it is in vm_state rescued {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:00:01.133354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-43094aae-7e97-427a-8014-6762dcbad0b0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088020 Sep 15 09:00:01.133354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 230/479] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:00:01 2021] POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 09:00:01.145712 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0cfed588-463c-4d49-8e4f-14a73450d48b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:01.146392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0cfed588-463c-4d49-8e4f-14a73450d48b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:01.153677 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cfed588-463c-4d49-8e4f-14a73450d48b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.154234 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cfed588-463c-4d49-8e4f-14a73450d48b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.155068 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cfed588-463c-4d49-8e4f-14a73450d48b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.155567 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cfed588-463c-4d49-8e4f-14a73450d48b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.346020 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:01.346657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:01.354376 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.354817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.355610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.356033 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.442973 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0cfed588-463c-4d49-8e4f-14a73450d48b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action" status: 202 len: 0 microversion: 2.1 time: 0.306121 Sep 15 09:00:01.443621 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 250/480] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:00:01 2021] POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:00:01.457792 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:01.458517 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:01.466143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.466595 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.467496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.467931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.572604 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:01.581349 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b78d3461-b921-4954-996a-d1c9d3e77c24 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.244558 Sep 15 09:00:01.581916 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 231/481] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:01 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:01.678487 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:01.679098 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:01.686531 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.686978 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.687764 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:01.688194 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:01.689535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:01.698112 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-752c2280-3d0f-4f9f-9487-7bfd356dc86a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1509 microversion: 2.1 time: 0.250088 Sep 15 09:00:01.707583 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 251/482] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:01 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:02.061130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:02.069426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-39977ae4-a22d-4b17-9608-baa6bd7f72ee tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.400520 Sep 15 09:00:02.070476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 232/483] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:01 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:02.603501 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:02.604211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:02.611357 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:02.611799 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:02.612562 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:02.612990 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:02.721924 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:02.726064 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:02.730238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:02.730951 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:02.731871 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:02.732300 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:02.826394 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:02.850242 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0e7d11c4-8ea4-463a-9c22-649d7d68e925 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.255798 Sep 15 09:00:02.859889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 252/484] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:02 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:02.995131 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:03.005099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e46747a0-11f0-4f34-9ba1-81252b9319ab tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1509 microversion: 2.1 time: 0.292853 Sep 15 09:00:03.005636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 233/485] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:02 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:03.092835 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:03.093918 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:03.102778 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:03.103226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:03.104165 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:03.104600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:03.263693 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:03.264267 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:03.277712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:03.278732 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:03.279739 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:03.280184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:03.351914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:03.357928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-10b18813-9e72-41b2-932f-61df82e6509b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.274367 Sep 15 09:00:03.358838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 253/486] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:03 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:03.364441 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lazy-loading 'flavor' on Instance uuid 5ba14ca7-eb88-437e-9c49-5101925f639b {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:00:03.873525 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:03.874162 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:03.881332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:03.881790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:03.882582 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:03.883040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.102756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:04.108355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-59566fcd-bd79-4a94-b643-66564b34ba0a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 202 len: 0 microversion: 2.20 time: 0.856981 Sep 15 09:00:04.109443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 234/487] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:00:03 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 09:00:04.111765 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fb35de19-dd62-4d86-8d84-a5ee9f022321 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.248275 Sep 15 09:00:04.121757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 254/488] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:03 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:04.132240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:04.132908 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:04.142992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.143445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.146463 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:04.147154 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:04.152793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.153224 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.158368 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.159068 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.160363 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.161022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.369935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:04.381260 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:04.385579 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:04.389827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-15efa615-93ee-4e33-89aa-01537f692e77 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1509 microversion: 2.1 time: 0.279155 Sep 15 09:00:04.390392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 235/489] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:04 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:04.400867 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:04.401480 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:04.407886 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:04.409030 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-551d5ecf-5144-4d3f-935f-4c388893bfe9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.286174 Sep 15 09:00:04.409154 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.409494 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.409601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 255/490] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:04 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:04.415701 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.416239 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.433951 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8edc5ffc-8636-4db1-b95a-5c00fefa265e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "647067bc-33ec-468d-8eda-c76e29794b25"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:04.435160 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8edc5ffc-8636-4db1-b95a-5c00fefa265e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:04.443062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8edc5ffc-8636-4db1-b95a-5c00fefa265e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.443507 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8edc5ffc-8636-4db1-b95a-5c00fefa265e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.444289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8edc5ffc-8636-4db1-b95a-5c00fefa265e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:04.444723 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8edc5ffc-8636-4db1-b95a-5c00fefa265e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:04.646841 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:04.656801 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d34a79ec-0792-4dd8-8475-374533a8c109 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.265339 Sep 15 09:00:04.657435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 236/491] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:04 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:05.133642 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:05.134291 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:05.141616 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.142065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.143062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.143712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.347560 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:05.356075 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-039bd34b-8e17-4378-b08d-c0e2454998c2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.231393 Sep 15 09:00:05.356604 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 237/492] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:05 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:05.432051 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:05.432685 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:05.439907 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.440355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.441115 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.441542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.467158 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8edc5ffc-8636-4db1-b95a-5c00fefa265e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.042698 Sep 15 09:00:05.473442 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 256/493] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:00:04 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-volume_attachments => generated 194 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:05.491891 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:05.492609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:05.502355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.502802 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.503569 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.504169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.683139 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:05.699306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:05.707908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:05.707908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fd389f80-96b5-4ef6-91c8-59a538f51a99 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.284642 Sep 15 09:00:05.711828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 238/494] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:05 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:05.721469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:05.724392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:05.725348 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:05.731213 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-175514ba-5d7a-4dc2-96a4-6ce4eac6804b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1509 microversion: 2.1 time: 0.256185 Sep 15 09:00:05.732043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 257/495] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:05 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:05.733847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.734335 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.740095 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.740095 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.847357 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6724d9af-fd27-4e00-b972-8ad239a6b494"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:05.849634 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:05.861603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.862137 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.863655 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:05.864343 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:05.949193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] HTTP exception thrown: Invalid volume: volume 6724d9af-fd27-4e00-b972-8ad239a6b494 already attached Sep 15 09:00:05.950008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Returning 400 to user: Invalid volume: volume 6724d9af-fd27-4e00-b972-8ad239a6b494 already attached {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:00:05.950856 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-89380331-d98c-4f5f-9eab-ca6d8341ae26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.117858 Sep 15 09:00:05.951649 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 258/496] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:00:05 2021] POST /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 120 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 15 09:00:05.997276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:06.005701 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1d1f8109-a6b6-43e0-a7e8-698ddf0c1941 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.292394 Sep 15 09:00:06.007694 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 239/497] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:05 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:06.070172 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-786060ea-8a45-467a-bc06-997c50695216 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:06.070782 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-786060ea-8a45-467a-bc06-997c50695216 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:06.078011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-786060ea-8a45-467a-bc06-997c50695216 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.078577 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-786060ea-8a45-467a-bc06-997c50695216 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.079411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-786060ea-8a45-467a-bc06-997c50695216 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.079909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-786060ea-8a45-467a-bc06-997c50695216 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.377772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:06.378485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:06.385577 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.386019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.386810 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.387242 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.583227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-786060ea-8a45-467a-bc06-997c50695216 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "DELETE /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments/6724d9af-fd27-4e00-b972-8ad239a6b494" status: 202 len: 0 microversion: 2.1 time: 0.522099 Sep 15 09:00:06.584663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 259/498] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:00:06 2021] DELETE /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments/6724d9af-fd27-4e00-b972-8ad239a6b494 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:00:06.594543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:06.607983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fa459ada-cb60-4202-8bc8-4a3c6c17cc33 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:06.609852 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fa459ada-cb60-4202-8bc8-4a3c6c17cc33 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:06.614332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-878b3285-a371-4832-b1f1-d9ac9b5203f5 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.245375 Sep 15 09:00:06.614870 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 240/499] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:06 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:06.618799 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa459ada-cb60-4202-8bc8-4a3c6c17cc33 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.619241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa459ada-cb60-4202-8bc8-4a3c6c17cc33 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.620478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa459ada-cb60-4202-8bc8-4a3c6c17cc33 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.620478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa459ada-cb60-4202-8bc8-4a3c6c17cc33 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.691687 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fa459ada-cb60-4202-8bc8-4a3c6c17cc33 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095255 Sep 15 09:00:06.692412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 260/500] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:06 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:06.734432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:06.734960 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:06.744554 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.745126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.746102 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.746640 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.755512 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:06.756324 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:06.764251 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.764575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:06.765357 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:06.765929 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.008983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:07.020945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-943ad2fe-9a6e-4d1b-a1e3-40e958421420 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1515 microversion: 2.1 time: 0.275955 Sep 15 09:00:07.021506 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 261/501] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:06 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:07.037805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-cc36c4ea-4af7-4ec5-8997-0456d10fbbf5 req-4f807dea-7d17-4db1-bd0f-6d9b49cb60d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab441b-e63b-43fe-9379-802feabe79af", "name": "network-vif-plugged", "status": "completed", "tag": "88421ab9-f482-4ad4-9055-bff29835d130"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:07.041053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:07.041053 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:00:07.049625 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-cc36c4ea-4af7-4ec5-8997-0456d10fbbf5 req-4f807dea-7d17-4db1-bd0f-6d9b49cb60d7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:07.050068 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-cc36c4ea-4af7-4ec5-8997-0456d10fbbf5 req-4f807dea-7d17-4db1-bd0f-6d9b49cb60d7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.066966 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-cc36c4ea-4af7-4ec5-8997-0456d10fbbf5 req-4f807dea-7d17-4db1-bd0f-6d9b49cb60d7 service nova] Creating event network-vif-plugged:88421ab9-f482-4ad4-9055-bff29835d130 for instance 72ab441b-e63b-43fe-9379-802feabe79af on hv-cinder-80600 Sep 15 09:00:07.073487 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-cc36c4ea-4af7-4ec5-8997-0456d10fbbf5 req-4f807dea-7d17-4db1-bd0f-6d9b49cb60d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050779 Sep 15 09:00:07.074289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 262/502] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:07.076436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:07.086623 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:07.087320 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:07.090567 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:07.095246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:07.095688 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.096458 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:07.096981 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.100032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:07.100032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-37121407-d65d-439a-9449-c1b81a30fa39 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.374123 Sep 15 09:00:07.100032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 241/503] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:06 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:07.320150 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:07.328590 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1bc6e79a-0b2a-4ef2-828f-7abfaed2226d tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.253165 Sep 15 09:00:07.329111 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 263/504] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:07 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:07.641262 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:07.641909 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:07.649406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:07.650611 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.650732 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:07.651065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.720403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1f55fb79-b079-405c-a577-53e375a07ffb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:07.720403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1f55fb79-b079-405c-a577-53e375a07ffb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:07.726217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f55fb79-b079-405c-a577-53e375a07ffb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:07.726819 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f55fb79-b079-405c-a577-53e375a07ffb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.727961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f55fb79-b079-405c-a577-53e375a07ffb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:07.728563 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f55fb79-b079-405c-a577-53e375a07ffb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:07.809096 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1f55fb79-b079-405c-a577-53e375a07ffb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107698 Sep 15 09:00:07.812593 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 264/505] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:07 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:08.016745 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:08.024827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-36ea2ef3-823e-4db0-b541-c109cbfedb07 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.393439 Sep 15 09:00:08.025384 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 242/506] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:07 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:08.124424 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:08.125194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:08.133067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.133508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:08.134311 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.134744 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:08.333125 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:08.346396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:08.350836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:08.351922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:08.353048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:08.354179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c7146d21-5c2c-46a8-b3ee-6196618ee479 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.241388 Sep 15 09:00:08.354696 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 265/507] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:08 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:08.359037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.359480 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:08.360241 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.360668 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:08.557494 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:08.565578 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5581d892-8995-494a-9667-01eee61b52d8 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.223789 Sep 15 09:00:08.566121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 243/508] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:08 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:08.826317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-07569b24-e915-4e96-8efa-8bfc4d564cf5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:08.827757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-07569b24-e915-4e96-8efa-8bfc4d564cf5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:08.835943 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07569b24-e915-4e96-8efa-8bfc4d564cf5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.836610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07569b24-e915-4e96-8efa-8bfc4d564cf5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:08.837601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07569b24-e915-4e96-8efa-8bfc4d564cf5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.838219 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-07569b24-e915-4e96-8efa-8bfc4d564cf5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:08.919924 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-07569b24-e915-4e96-8efa-8bfc4d564cf5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103641 Sep 15 09:00:08.920668 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 266/509] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:08 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:08.931533 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:08.932150 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:08.939362 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.939802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:08.940663 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:08.941089 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.048122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:09.048915 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:09.057806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.058425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.059313 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.059930 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.155586 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:09.164644 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-122cbf91-a3f1-42a8-9e21-d378834bd23f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1515 microversion: 2.1 time: 0.257752 Sep 15 09:00:09.165315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 244/510] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:08 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1515 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:09.175395 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-8d3a2ed5-b054-449d-8192-f4dc2bf7e8d7 req-5dd49fce-d002-4ace-bb83-72302f488eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8493648-d1a6-4d4d-bceb-4513f9bcb75f", "name": "network-vif-plugged", "status": "completed", "tag": "46a75e53-1878-499f-89c2-34e2b09778a8"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:09.181967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:09.181967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:00:09.190177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-8d3a2ed5-b054-449d-8192-f4dc2bf7e8d7 req-5dd49fce-d002-4ace-bb83-72302f488eb4 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.190694 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-8d3a2ed5-b054-449d-8192-f4dc2bf7e8d7 req-5dd49fce-d002-4ace-bb83-72302f488eb4 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.206380 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-8d3a2ed5-b054-449d-8192-f4dc2bf7e8d7 req-5dd49fce-d002-4ace-bb83-72302f488eb4 service nova] Creating event network-vif-plugged:46a75e53-1878-499f-89c2-34e2b09778a8 for instance f8493648-d1a6-4d4d-bceb-4513f9bcb75f on hv-cinder-80600 Sep 15 09:00:09.211565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-8d3a2ed5-b054-449d-8192-f4dc2bf7e8d7 req-5dd49fce-d002-4ace-bb83-72302f488eb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044364 Sep 15 09:00:09.212145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 245/511] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:09.222592 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-62404b83-083e-4d1b-978a-c45c4893e319 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcfcbc6e-ef7a-4445-81c9-2532c04a33d6"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:09.223741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-62404b83-083e-4d1b-978a-c45c4893e319 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:09.231717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62404b83-083e-4d1b-978a-c45c4893e319 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.232162 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62404b83-083e-4d1b-978a-c45c4893e319 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.232928 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62404b83-083e-4d1b-978a-c45c4893e319 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.233360 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62404b83-083e-4d1b-978a-c45c4893e319 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.278338 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:09.295219 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-05ec25e4-a6df-497f-91d3-5acd6d458c6c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.257011 Sep 15 09:00:09.297962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 267/512] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:09 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:09.379652 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:09.380566 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:09.388648 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.398735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.399722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.400332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.610575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:09.624859 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:09.631172 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:09.632370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8f0ddda6-e267-40c8-9195-cd7c9887f3f6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.264012 Sep 15 09:00:09.632832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 268/513] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:09 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:09.642914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:09.643110 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:09.650322 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.650771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.651536 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.651984 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.903280 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:09.912070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-21abd48b-3fab-4217-9189-f0a84fdcd999 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1314 microversion: 2.1 time: 0.278259 Sep 15 09:00:09.926843 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 269/514] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:09 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:09.937146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1c970a95-5676-4333-8107-0fa4408ba59e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:09.938192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1c970a95-5676-4333-8107-0fa4408ba59e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:09.945291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1c970a95-5676-4333-8107-0fa4408ba59e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.945734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1c970a95-5676-4333-8107-0fa4408ba59e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:09.946548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1c970a95-5676-4333-8107-0fa4408ba59e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:09.946979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1c970a95-5676-4333-8107-0fa4408ba59e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.017899 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1c970a95-5676-4333-8107-0fa4408ba59e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089766 Sep 15 09:00:10.018489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 270/515] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:09 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:10.317280 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:10.317884 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:10.325551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.325999 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.326801 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.327250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.413798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-62404b83-083e-4d1b-978a-c45c4893e319 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.200191 Sep 15 09:00:10.414362 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 246/516] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:00:09 2021] POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments => generated 194 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:10.532849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:10.541419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6cc2e985-5c8a-409e-beb3-670fbf2f5be8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.233217 Sep 15 09:00:10.541949 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 271/517] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:10 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:10.656153 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:10.694379 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:10.694379 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.694379 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.694379 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.696484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.871982 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:10.886077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:10.892231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:10.893339 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6b1bea6d-ae2a-4a74-9444-d35c686ff032 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.246628 Sep 15 09:00:10.893849 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 247/518] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:10 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:10.939417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:10.940014 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:10.947944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.948325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.949095 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.949519 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.983787 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-df7e54c9-5925-4dd7-b6f5-5c8973c4134c tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1891ea11-d3e1-4195-9be2-bd5acae42903", "device": "/dev/sdb"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:10.985391 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-df7e54c9-5925-4dd7-b6f5-5c8973c4134c tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:10.994469 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-df7e54c9-5925-4dd7-b6f5-5c8973c4134c tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.994915 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-df7e54c9-5925-4dd7-b6f5-5c8973c4134c tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:10.995836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-df7e54c9-5925-4dd7-b6f5-5c8973c4134c tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:10.996409 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-df7e54c9-5925-4dd7-b6f5-5c8973c4134c tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.168374 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:11.176435 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0270d5a1-f407-4dc4-897e-38339b60ec28 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1464 microversion: 2.1 time: 0.246830 Sep 15 09:00:11.182739 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 272/519] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:10 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1464 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:11.193913 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f4e0d949-b243-44cb-ae8d-55a219e908b7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:11.194905 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f4e0d949-b243-44cb-ae8d-55a219e908b7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:11.203073 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e0d949-b243-44cb-ae8d-55a219e908b7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.203798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e0d949-b243-44cb-ae8d-55a219e908b7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.204736 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e0d949-b243-44cb-ae8d-55a219e908b7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.205360 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e0d949-b243-44cb-ae8d-55a219e908b7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.286684 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f4e0d949-b243-44cb-ae8d-55a219e908b7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102266 Sep 15 09:00:11.287229 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 273/520] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:11 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:11.296906 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:11.297389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:11.304522 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.304960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.305757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.306211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.371294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:00:11.759547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-308f7a31-4647-4f4c-a634-8d933a332fdf tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "DELETE /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 204 len: 0 microversion: 2.1 time: 0.471058 Sep 15 09:00:11.760134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 274/521] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:00:11 2021] DELETE /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:00:11.770735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:11.771372 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:11.778370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.778812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.779578 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.780001 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.912824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-df7e54c9-5925-4dd7-b6f5-5c8973c4134c tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "POST /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938939 Sep 15 09:00:11.918659 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 248/522] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:00:10 2021] POST /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:00:11.925918 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:11.926793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:11.936898 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.937462 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.938406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:11.938942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:11.999572 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:12.007010 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-78f5c67f-8c61-4a02-9765-2fee7716ff7a tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.245604 Sep 15 09:00:12.017132 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 275/523] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:11 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:12.025645 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:12.026222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:12.033335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:12.033781 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:12.034587 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:12.035023 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:12.170563 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:12.181804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2dbd28ee-d421-4916-9259-5eea996985c7 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1470 microversion: 2.1 time: 0.266861 Sep 15 09:00:12.182429 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 249/524] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:11 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:12.249418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:12.264816 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:12.270952 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:12.272057 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2698da1a-5fa3-45b5-8f2f-69669e405452 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.263607 Sep 15 09:00:12.272611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 276/525] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:12 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:12.304010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5a0246c8-9fea-4d36-833f-a8eaafb94ad0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:12.304981 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5a0246c8-9fea-4d36-833f-a8eaafb94ad0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:12.312708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0246c8-9fea-4d36-833f-a8eaafb94ad0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:12.313148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0246c8-9fea-4d36-833f-a8eaafb94ad0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:12.313910 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0246c8-9fea-4d36-833f-a8eaafb94ad0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:12.314371 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0246c8-9fea-4d36-833f-a8eaafb94ad0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:12.385800 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5a0246c8-9fea-4d36-833f-a8eaafb94ad0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091472 Sep 15 09:00:12.386773 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 250/526] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:12 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:13.029191 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:13.029805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:13.037269 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.037721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.038518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.038956 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.204964 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:13.205571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:13.213053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.213495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.214301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.214732 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.291262 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:13.299329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-eca3af31-f363-4eb7-b788-d5191e48199d tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.279299 Sep 15 09:00:13.300151 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 277/527] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:13 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:13.310168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:13.310762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:13.318166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.318543 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.319308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.319737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.432016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:13.443407 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-abb9d27f-5bd9-47b2-999a-d06217b5818a tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1470 microversion: 2.1 time: 0.245982 Sep 15 09:00:13.443407 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 251/528] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:13 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:13.452412 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c047d781-df3b-4240-9fb7-65703a26dc26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:13.453336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c047d781-df3b-4240-9fb7-65703a26dc26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:13.461203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c047d781-df3b-4240-9fb7-65703a26dc26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.461682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c047d781-df3b-4240-9fb7-65703a26dc26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.462682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c047d781-df3b-4240-9fb7-65703a26dc26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:13.463259 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c047d781-df3b-4240-9fb7-65703a26dc26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:13.546668 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c047d781-df3b-4240-9fb7-65703a26dc26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103566 Sep 15 09:00:13.547218 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 252/529] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:13 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:13.561386 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:13.574812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:13.581080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:13.582070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ccf818af-904b-4715-9dfc-d53ca4d2106e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.281303 Sep 15 09:00:13.582800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 278/530] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:13 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:14.320929 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:14.321526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:14.328613 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.329050 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.329810 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.330266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.463459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:14.464334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:14.471438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.472078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.473013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.473445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.539589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:14.548176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d586e3b1-e61f-47dc-b9a7-b9521ae3cc37 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1313 microversion: 2.1 time: 0.236260 Sep 15 09:00:14.550214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 253/531] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:14 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:14.563644 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1616f44a-d3e0-4009-95ce-5bd0df68761d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:14.564872 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1616f44a-d3e0-4009-95ce-5bd0df68761d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:14.572609 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1616f44a-d3e0-4009-95ce-5bd0df68761d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.573061 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1616f44a-d3e0-4009-95ce-5bd0df68761d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.573837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1616f44a-d3e0-4009-95ce-5bd0df68761d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.574296 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1616f44a-d3e0-4009-95ce-5bd0df68761d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.657618 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1616f44a-d3e0-4009-95ce-5bd0df68761d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103348 Sep 15 09:00:14.661417 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 254/532] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:14 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:00:14.671138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:14.671856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:14.680414 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.680952 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.681813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.682485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.724379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:14.733484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f7dac4cd-7628-4f6a-9d83-eca305a2632b tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1470 microversion: 2.1 time: 0.279649 Sep 15 09:00:14.738151 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 279/533] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:14 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:14.847601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fbb7d196-8b68-434a-b8d1-b2e93d727132 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:14.857764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fbb7d196-8b68-434a-b8d1-b2e93d727132 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:14.858421 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fbb7d196-8b68-434a-b8d1-b2e93d727132 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:14.925028 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:14.927641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fbb7d196-8b68-434a-b8d1-b2e93d727132 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Going to try to stop instance {{(pid=89582) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Sep 15 09:00:14.949870 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:14.958208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:14.959429 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d85e54a3-584d-4bbc-8590-c5953d79e087 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.299722 Sep 15 09:00:14.961387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 255/534] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:14 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:15.128925 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fbb7d196-8b68-434a-b8d1-b2e93d727132 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 202 len: 0 microversion: 2.1 time: 0.298846 Sep 15 09:00:15.134838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 280/535] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:00:14 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:00:15.144942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:15.145673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:15.168630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.168630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.168630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.168630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.487580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:15.497414 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fd649d63-c7fc-4bbd-a3f8-ba52b028c8c6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.362768 Sep 15 09:00:15.504300 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 256/536] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:15 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:15.570969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:15.571651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:15.579227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.579671 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.580477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.580900 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.675632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-65d6aa3c-4de6-40d8-b17b-34d42f697ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:15.676880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-65d6aa3c-4de6-40d8-b17b-34d42f697ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:15.685652 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65d6aa3c-4de6-40d8-b17b-34d42f697ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.686392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65d6aa3c-4de6-40d8-b17b-34d42f697ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.687888 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65d6aa3c-4de6-40d8-b17b-34d42f697ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.688531 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65d6aa3c-4de6-40d8-b17b-34d42f697ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.772284 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-65d6aa3c-4de6-40d8-b17b-34d42f697ba7 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106666 Sep 15 09:00:15.772831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 257/537] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:15 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:00:15.783740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:15.784340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:15.792385 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.792821 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.793613 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.794224 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.810188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:15.821995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-52858195-efa6-439f-a9f4-aaa418707ed3 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1496 microversion: 2.1 time: 0.261008 Sep 15 09:00:15.834705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 281/538] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:15 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1496 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:15.983013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:15.983699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:15.991019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.991717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:15.992572 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:15.993007 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:16.212941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:16.224623 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:16.227979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:16.234395 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:16.235516 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4e4fb652-32e9-41c7-a8d6-1f85a1d704f3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.262698 Sep 15 09:00:16.236081 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b89cf996-4355-43b1-baf1-55c9797b3ec0 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1470 microversion: 2.1 time: 0.461912 Sep 15 09:00:16.236197 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 282/539] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:15 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:16.237375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 258/540] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:15 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1470 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:16.423610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-752eca71-4a45-4a97-9a79-00028c3ad939 req-d5bacf0e-54ab-4214-86f2-5223ac19b5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab441b-e63b-43fe-9379-802feabe79af", "name": "network-vif-deleted", "tag": "88421ab9-f482-4ad4-9055-bff29835d130"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:16.434472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:16.434472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:00:16.443345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-752eca71-4a45-4a97-9a79-00028c3ad939 req-d5bacf0e-54ab-4214-86f2-5223ac19b5be service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:16.443898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-752eca71-4a45-4a97-9a79-00028c3ad939 req-d5bacf0e-54ab-4214-86f2-5223ac19b5be service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:16.462614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-752eca71-4a45-4a97-9a79-00028c3ad939 req-d5bacf0e-54ab-4214-86f2-5223ac19b5be service nova] Creating event network-vif-deleted:88421ab9-f482-4ad4-9055-bff29835d130 for instance 72ab441b-e63b-43fe-9379-802feabe79af on hv-cinder-80600 Sep 15 09:00:16.468056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-752eca71-4a45-4a97-9a79-00028c3ad939 req-d5bacf0e-54ab-4214-86f2-5223ac19b5be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053272 Sep 15 09:00:16.468418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 283/541] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:16.531717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:16.532987 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:16.541112 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:16.541648 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:16.542616 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:16.543167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:16.797306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-025ee755-1209-467e-8bc5-15c7bc35a6f4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:16.799206 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-025ee755-1209-467e-8bc5-15c7bc35a6f4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:16.808906 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-025ee755-1209-467e-8bc5-15c7bc35a6f4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:16.809633 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-025ee755-1209-467e-8bc5-15c7bc35a6f4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:16.810662 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-025ee755-1209-467e-8bc5-15c7bc35a6f4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:16.811355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-025ee755-1209-467e-8bc5-15c7bc35a6f4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:16.819664 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:16.830025 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b98ca7c9-4e63-4053-a37a-69ef164b9842 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.314320 Sep 15 09:00:16.834352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 259/542] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:16 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:16.911471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-025ee755-1209-467e-8bc5-15c7bc35a6f4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130809 Sep 15 09:00:16.912166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 284/543] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:00:16 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 09:00:17.258846 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:17.259192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:17.259376 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:17.259811 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:17.266982 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:17.267442 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:17.268213 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:17.268683 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:17.268796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:17.269215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:17.269987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:17.270448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:17.347206 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:17.347643 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:17.348075 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lazy-loading 'fault' on Instance uuid 72ab441b-e63b-43fe-9379-802feabe79af {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:00:17.493077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:17.506628 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:17.509950 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c381af2e6b4821827d5e52d702e418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b6343f1c844d948bcc8ac62e2214b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:17.513280 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:17.514425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-91eeb720-6098-4f37-9497-86a29d6ddaaf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.264406 Sep 15 09:00:17.514956 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 285/544] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:17 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:17.518664 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7d0125fa-3ffa-43d3-ba70-bb3e63c6bc96 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 200 len: 1304 microversion: 2.1 time: 0.269303 Sep 15 09:00:17.527928 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 260/545] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:17 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 1304 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:17.852639 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:17.853807 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:17.861281 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:17.861977 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:17.862752 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:17.863326 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:17.982006 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-571724250", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "1c409703-0674-4cbb-9f3e-f398f357604d"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:18.072163 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] validate_networks() for [('1c409703-0674-4cbb-9f3e-f398f357604d', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:00:18.107706 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:18.118304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-45614236-75c6-4528-9d42-6642fe2772e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.274458 Sep 15 09:00:18.128138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 286/546] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:17 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:18.139370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:18.139863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:18.147068 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.147510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.148575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.149362 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.220728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:00:18.581179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-52a1108a-4154-4843-a0e9-0fb36666f2c1 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 204 len: 0 microversion: 2.1 time: 0.451562 Sep 15 09:00:18.581684 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 287/547] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:00:18 2021] DELETE /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:00:18.593184 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:18.593877 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:18.601040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.601488 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.602295 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.602721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.612499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:00:18.612911 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:00:18.614262 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:00:18.614262 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:00:18.615024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:00:18.623870 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.624447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.625342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.625705 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.646203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:00:18.651261 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Getting quotas for user aa9a7f77c7354c099697032b66c9a99a and project b1349b239f2142be8df3073348f83d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:00:18.662805 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:00:18.665272 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:00:18.796027 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-03b2ca1d-5ba1-4aef-9684-fbeebc678596 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823140 Sep 15 09:00:18.797161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 261/548] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:00:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 09:00:18.809855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:18.810757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] [instance: 72ab441b-e63b-43fe-9379-802feabe79af] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:18.822880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.823960 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.825315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.825537 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.838437 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:18.868719 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:18.875607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:18.876913 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e4c81766-20bf-4983-b07b-1fdd4215a5f0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.294132 Sep 15 09:00:18.877586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 288/549] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:18 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:18.880297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] HTTP exception thrown: Instance 72ab441b-e63b-43fe-9379-802feabe79af could not be found. Sep 15 09:00:18.881011 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] Returning 404 to user: Instance 72ab441b-e63b-43fe-9379-802feabe79af could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:00:18.881895 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2caa6997-bfec-403b-81e5-92543fa60514 tempest-VolumesNegativeTest-1041937632 tempest-VolumesNegativeTest-1041937632-project] 10.222.0.39 "GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af" status: 404 len: 111 microversion: 2.1 time: 0.083447 Sep 15 09:00:18.882523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 262/550] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:18 2021] GET /compute/v2.1/servers/72ab441b-e63b-43fe-9379-802feabe79af => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:00:18.894961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:18.895383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-14a60ce5-9485-4fe0-9075-2119d4311d17 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:18.895570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:18.896324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-14a60ce5-9485-4fe0-9075-2119d4311d17 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:18.905188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.905629 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.906423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:18.906863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:18.985201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-14a60ce5-9485-4fe0-9075-2119d4311d17 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:18.994369 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-14a60ce5-9485-4fe0-9075-2119d4311d17 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1217 microversion: 2.1 time: 0.110054 Sep 15 09:00:18.995225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 263/551] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:18 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:19.144479 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:19.145975 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:19.156125 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:19.158170 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:19.158170 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:19.158348 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:19.183271 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:19.220100 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cb91d4f4-4ebb-4406-a3ea-d15660286eac tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1502 microversion: 2.1 time: 0.341063 Sep 15 09:00:19.221240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 289/552] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:18 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:19.450041 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:19.462015 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-78cda3cd-861f-40ba-8eba-c354a2032302 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.328990 Sep 15 09:00:19.462931 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 264/553] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:19 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:19.902529 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:19.903060 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:19.910391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:19.910838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:19.911607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:19.912034 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:20.019590 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:20.020279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:20.030847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:20.031332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:20.032165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:20.032592 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:20.133765 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:20.180189 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:20.188965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:20.196070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:20.203493 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f9760f20-d574-4e55-b819-026fcd2fa5e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.304928 Sep 15 09:00:20.206206 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-16cedfc0-6be5-4a43-9ace-846480e087d6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1221 microversion: 2.1 time: 0.198143 Sep 15 09:00:20.206853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 265/554] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:20 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:20.207301 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 290/555] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:19 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:20.243356 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:20.243961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:20.251126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:20.251570 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:20.252996 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:20.253449 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:20.480684 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:20.495707 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:20.495980 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4d87ff54-8510-4b5f-8fc9-9920b0baedd2 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1502 microversion: 2.1 time: 0.261813 Sep 15 09:00:20.496739 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:20.497259 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 266/556] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:20 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:20.505109 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:20.505553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:20.506423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:20.506909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:20.722539 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:20.731776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cff7ab6c-a6ac-4e97-a497-30698f648319 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.255159 Sep 15 09:00:20.732419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 291/557] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:20 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:21.228600 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:21.229202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:21.229343 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:21.229862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:21.237246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.237876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:21.241032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.241032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:21.246545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.250415 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:21.251359 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.251859 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:21.372036 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:21.383931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-56340cf3-c7e5-48e9-91b0-81e2c5b9be06 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1269 microversion: 2.1 time: 0.164090 Sep 15 09:00:21.384338 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 292/558] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:21 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:21.524192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:21.524192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:21.539828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.540617 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:21.541429 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.541960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:21.827645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:21.862219 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:21.875598 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:21.876748 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fc117f96-8fbe-4d56-b121-d3ecdd605cc4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.657741 Sep 15 09:00:21.877315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 267/559] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:21 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:21.887477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:21.888270 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:21.895849 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.896285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:21.897319 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:21.897921 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:22.072288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:22.083052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5a2555db-0c95-45e8-af8b-9c9b9dc76f5c tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1502 microversion: 2.1 time: 0.572906 Sep 15 09:00:22.084370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 293/560] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:21 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1502 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:22.180081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-d07a9ba5-dd8b-419a-bdae-5734b9c906eb req-a5838e5c-90a8-400b-a14c-cfaa883ba67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8493648-d1a6-4d4d-bceb-4513f9bcb75f", "name": "network-vif-deleted", "tag": "46a75e53-1878-499f-89c2-34e2b09778a8"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:22.186570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:22.186570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:00:22.194640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-d07a9ba5-dd8b-419a-bdae-5734b9c906eb req-a5838e5c-90a8-400b-a14c-cfaa883ba67c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:22.195120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-d07a9ba5-dd8b-419a-bdae-5734b9c906eb req-a5838e5c-90a8-400b-a14c-cfaa883ba67c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:22.216715 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-d07a9ba5-dd8b-419a-bdae-5734b9c906eb req-a5838e5c-90a8-400b-a14c-cfaa883ba67c service nova] Creating event network-vif-deleted:46a75e53-1878-499f-89c2-34e2b09778a8 for instance f8493648-d1a6-4d4d-bceb-4513f9bcb75f on hv-cinder-80600 Sep 15 09:00:22.222045 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-d07a9ba5-dd8b-419a-bdae-5734b9c906eb req-a5838e5c-90a8-400b-a14c-cfaa883ba67c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051639 Sep 15 09:00:22.222728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 294/561] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:00:22.254685 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:22.264376 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-84cd191c-513e-4c9a-8426-1329a385e37e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.385873 Sep 15 09:00:22.264830 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 268/562] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:21 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:22.411164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:22.412689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:22.423335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:22.424138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:22.425396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:22.426668 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:22.670993 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:22.681245 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fd56e914-7480-448c-853f-c55943ae3e1b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1275 microversion: 2.1 time: 0.280901 Sep 15 09:00:22.690704 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 295/563] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:22 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:22.910825 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:22.914314 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:22.924237 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:22.925170 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:22.926947 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:22.927765 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:23.106967 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:23.107604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:23.115673 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:23.116662 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:23.118826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:23.121441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:23.252077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:23.305401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:23.329759 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:23.336430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f41ce8db-ce76-4a91-8638-8162e8c89ae2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.440365 Sep 15 09:00:23.337409 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 269/564] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:22 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:23.377968 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:23.379266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:23.401600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:23.402190 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:23.402695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lazy-loading 'fault' on Instance uuid f8493648-d1a6-4d4d-bceb-4513f9bcb75f {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:00:23.404812 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:23.405894 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:23.407242 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:23.407678 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:23.490381 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dc7acffefb4404af415ceaac2283f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1284f0069453d9dc1923926636b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:23.511328 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a76db891-ed13-481e-be00-072e1b874fbb tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 200 len: 1303 microversion: 2.1 time: 0.414198 Sep 15 09:00:23.516292 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 296/565] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:23 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 1303 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:23.673328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:23.682458 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a3221ecb-9f07-4baa-b3b9-cc4754b0121d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.331825 Sep 15 09:00:23.682991 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 270/566] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:23 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:23.719063 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:23.720087 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:23.730166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:23.730841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:23.731756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:23.732227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:24.301866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:24.311242 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fa260c5d-3305-42af-897b-8f35e6185926 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.616701 Sep 15 09:00:24.311873 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 297/567] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:23 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:24.362479 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:24.363059 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:24.372695 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:24.375688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:24.375688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:24.375688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:24.542721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:24.545846 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] [instance: f8493648-d1a6-4d4d-bceb-4513f9bcb75f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:24.562632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:24.563046 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:24.563823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:24.564254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:24.622062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] HTTP exception thrown: Instance f8493648-d1a6-4d4d-bceb-4513f9bcb75f could not be found. Sep 15 09:00:24.622681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] Returning 404 to user: Instance f8493648-d1a6-4d4d-bceb-4513f9bcb75f could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:00:24.623684 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-11c1e447-8356-4c51-9310-e9c25b841fc8 tempest-VolumesActionsTest-1149196759 tempest-VolumesActionsTest-1149196759-project] 10.222.0.39 "GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f" status: 404 len: 111 microversion: 2.1 time: 0.094899 Sep 15 09:00:24.624411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 298/568] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:24 2021] GET /compute/v2.1/servers/f8493648-d1a6-4d4d-bceb-4513f9bcb75f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:00:24.671023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:24.680317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-c5ea0d3c-d650-49da-b8c3-f306c6f78785 req-320e2639-76ce-44c1-87e3-ed401ce3adc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "588ad70f-a4ba-41bd-98fc-3b3d3fd24904", "tag": "331f1df2-a0ed-4351-a544-34bd746e8e93"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:24.685723 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:24.686971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:24.686971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:00:24.692882 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:24.694671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-758addcd-9005-4052-906c-beb934bc9aea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.341601 Sep 15 09:00:24.695080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-c5ea0d3c-d650-49da-b8c3-f306c6f78785 req-320e2639-76ce-44c1-87e3-ed401ce3adc7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:24.696289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-c5ea0d3c-d650-49da-b8c3-f306c6f78785 req-320e2639-76ce-44c1-87e3-ed401ce3adc7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:24.696826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 271/569] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:24 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:24.709247 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:24.710099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:24.714413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-c5ea0d3c-d650-49da-b8c3-f306c6f78785 req-320e2639-76ce-44c1-87e3-ed401ce3adc7 service nova] Creating event network-changed:331f1df2-a0ed-4351-a544-34bd746e8e93 for instance 588ad70f-a4ba-41bd-98fc-3b3d3fd24904 on hv-cinder-80600 Sep 15 09:00:24.719108 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-c5ea0d3c-d650-49da-b8c3-f306c6f78785 req-320e2639-76ce-44c1-87e3-ed401ce3adc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049498 Sep 15 09:00:24.719259 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:24.719546 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:24.719680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 299/570] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:24.720578 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:24.721006 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.032325 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:25.043364 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4784a610-0f2b-4b83-9e45-5ecccfdb0e78 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.345210 Sep 15 09:00:25.044139 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 272/571] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:24 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:25.126656 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:25.127697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:25.147070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.147513 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.148299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.148764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.229843 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'flavor' on Instance uuid 26d8f72b-fc30-41ab-922d-6e83c2b253e1 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:00:25.350030 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:25.350720 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:25.359019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.359416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.360432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.360980 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.638873 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:25.647266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bc5b8544-65a4-4d30-ae43-36da247f0e13 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.306863 Sep 15 09:00:25.647805 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 273/572] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:25 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:25.720647 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:25.721250 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:25.729471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.729922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.730717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.731148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.750689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c8b8b4b4-35ab-4c65-9e7e-8b886c49999e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action" status: 200 len: 32 microversion: 2.1 time: 0.634619 Sep 15 09:00:25.751577 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 300/573] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:00:25 2021] POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action => generated 32 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:00:25.768653 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:25.769348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:25.789118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.790067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.790862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:25.791367 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:25.977790 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:25.991845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:25.998124 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:25.999518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-396b0d74-dce1-46f0-911d-84a041da7ebc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1744 microversion: 2.20 time: 0.288780 Sep 15 09:00:26.000355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 274/574] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:25 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1744 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:26.067108 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:26.068062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:26.076684 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:26.077415 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:26.078776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:26.079187 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:26.458395 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:26.473144 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5923ca77-6da0-46c7-9099-2c2fb298b665 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.713985 Sep 15 09:00:26.473862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 301/575] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:25 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:26.669843 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:26.671417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:26.679335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:26.680422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:26.681700 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:26.682293 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:26.808086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:26.838229 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a79ee42f-642d-4339-b733-3ecedb2ad216 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.781164 Sep 15 09:00:26.842268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 275/576] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:26 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:26.948570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:26.959225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-696aa771-833a-4373-a703-071a266490b1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.298796 Sep 15 09:00:26.970995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 302/577] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:26 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:27.025130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:27.025748 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:27.033002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.033442 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:27.034248 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.034674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:27.481086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:27.496197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:27.496560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:27.497177 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:27.503929 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:27.504523 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.504975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:27.505745 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.506197 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:27.506677 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f2829246-9971-4922-a7a2-91e9d1daa7d2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1744 microversion: 2.20 time: 0.490682 Sep 15 09:00:27.526582 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 276/578] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:27 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1744 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:27.716688 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:27.725240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1998b57b-2208-4522-977e-9fa0fb14d8d9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.238889 Sep 15 09:00:27.726400 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 303/579] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:27 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:27.878519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:27.878519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:27.879666 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.880439 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:27.881457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.882101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:27.982734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:27.983288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:27.990992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.991438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:27.992962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:27.993396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:28.165888 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:28.176171 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-98a433e2-f6a7-4e89-85aa-28d24997789d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.317009 Sep 15 09:00:28.177062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 277/580] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:27 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:28.217168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:28.225116 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5d328cea-c3f2-4eec-a185-099091d8aa5c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.251955 Sep 15 09:00:28.225646 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 304/581] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:27 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:28.531325 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:28.532143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:28.540317 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:28.540976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:28.541760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:28.542294 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:28.740611 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:28.749120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:28.749732 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:28.758532 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:28.758669 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:28.758669 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:28.758842 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:28.759208 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:28.762028 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:28.763148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1d34a79c-1d0e-4756-8957-6cf14ef3f7fd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1744 microversion: 2.20 time: 0.242350 Sep 15 09:00:28.763661 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 278/582] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:28 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:28.961955 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:28.970545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-19b155f7-476e-4d31-b349-58707a729646 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.232232 Sep 15 09:00:28.971170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 305/583] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:28 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:29.198559 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:29.199171 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:29.206434 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:29.206883 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:29.207657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:29.210611 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:29.247492 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:29.248729 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:29.255973 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:29.256416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:29.257181 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:29.258107 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:29.425657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:29.434866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5f8f718c-f004-42f4-96b2-adc9f1b08c69 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.245940 Sep 15 09:00:29.435399 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 279/584] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:29 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:29.477471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:29.485606 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cf50beea-8b07-45f9-b677-bab4e507fec9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.247868 Sep 15 09:00:29.490129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 306/585] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:29 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:29.786477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:29.787024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:29.794610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:29.795058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:29.795824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:29.796252 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:29.994509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:29.995120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:30.003536 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:30.003982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:30.004749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:30.005178 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:30.009040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:30.022186 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:30.028775 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:30.029852 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ff9380d6-d131-4087-8a55-438e446f3803 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1744 microversion: 2.20 time: 0.252694 Sep 15 09:00:30.030394 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 280/586] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:29 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1744 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:30.213649 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:30.222192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d26527c0-c0c4-45ef-8fa8-99b7994bff39 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.237873 Sep 15 09:00:30.222715 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 307/587] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:29 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:30.457411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:30.458011 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:30.465130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:30.465567 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:30.466357 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:30.466821 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:30.508896 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:30.509563 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:30.516960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:30.517409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:30.518211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:30.518646 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:30.675876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:30.686257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d1182cb5-d828-498f-ac52-a35d18e69cbc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.237762 Sep 15 09:00:30.686795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 281/588] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:30 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:30.746370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:30.754910 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e2c177bc-1974-4d2c-afe4-4692eabd6627 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.255881 Sep 15 09:00:30.755446 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 308/589] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:30 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:31.053153 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:31.053749 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:31.060788 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.061226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:31.061984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.062442 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:31.245241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:31.245930 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:31.253349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.253818 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:31.254620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.255072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:31.272819 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:31.287856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:31.294114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:31.296741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-90184aca-83f9-43a5-9b5a-9477e3ad297e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1744 microversion: 2.20 time: 0.251171 Sep 15 09:00:31.306073 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 282/590] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:31 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:31.534737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:31.544381 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-029f8f0d-0f95-45e7-bc82-649e26def01b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.309040 Sep 15 09:00:31.545115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 309/591] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:31 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:31.711966 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:31.712646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:31.720017 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.720511 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:31.721286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.721712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:31.777441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:31.778369 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:31.788458 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.789317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:31.790389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:31.790925 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:32.019798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:32.028017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-208c3490-2c14-4ab2-805c-04f9f1af6daa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.260416 Sep 15 09:00:32.028553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 310/592] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:31 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:32.068359 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:32.077503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1ce44172-316f-49fd-8464-ce577d7f5093 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.376116 Sep 15 09:00:32.078540 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 283/593] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:31 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:32.318317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:32.319032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:32.326555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:32.327100 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:32.327953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:32.328460 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:32.551507 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:32.565177 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:32.566115 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:32.566734 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:32.571523 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:32.572586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0baea102-6658-4fbb-90e3-f584c902dbe5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.263457 Sep 15 09:00:32.573103 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 311/594] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:32 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:32.574055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:32.574531 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:32.575295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:32.575720 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:32.786858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:32.811115 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e10e6c64-0b4d-4085-8fd2-a07d22913daa tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.253945 Sep 15 09:00:32.811886 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 284/595] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:32 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:33.050681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:33.051109 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:33.059016 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.059461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.060232 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.060658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.101047 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:33.101691 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:33.109404 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.110109 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.111056 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.111636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.397450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:33.399341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:33.407548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-81b7bc21-4b7a-4b4a-a1bf-f34774296248 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.366632 Sep 15 09:00:33.408607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 312/596] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:33 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:33.420119 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-001410e7-5786-4ef8-9b69-59a1307d52cb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.328839 Sep 15 09:00:33.421346 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 285/597] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:33 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:33.603072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:33.604709 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:33.616719 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.617227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.618508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.619093 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.837415 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:33.837964 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:33.854503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.854947 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.855729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:33.856158 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:33.891356 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:33.928497 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:33.941407 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:33.942828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4fb4f9d1-e162-463c-b597-971d7648e550 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.350125 Sep 15 09:00:33.943837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 313/598] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:33 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:34.041985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-ad898ba0-dfd3-423f-8721-de168c5d69be req-922369ff-c604-4031-b5b4-2f4421f4750f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba14ca7-eb88-437e-9c49-5101925f639b", "name": "network-vif-plugged", "status": "completed", "tag": "314b817f-9c79-46cf-a672-a625eea4af10"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:34.048555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:34.048555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:00:34.092338 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-ad898ba0-dfd3-423f-8721-de168c5d69be req-922369ff-c604-4031-b5b4-2f4421f4750f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:34.096985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-ad898ba0-dfd3-423f-8721-de168c5d69be req-922369ff-c604-4031-b5b4-2f4421f4750f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:34.130826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-ad898ba0-dfd3-423f-8721-de168c5d69be req-922369ff-c604-4031-b5b4-2f4421f4750f service nova] Creating event network-vif-plugged:314b817f-9c79-46cf-a672-a625eea4af10 for instance 5ba14ca7-eb88-437e-9c49-5101925f639b on hv-cinder-80600 Sep 15 09:00:34.149036 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:34.150680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-ad898ba0-dfd3-423f-8721-de168c5d69be req-922369ff-c604-4031-b5b4-2f4421f4750f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125059 Sep 15 09:00:34.152389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 314/599] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:00:34.159787 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-eda3be17-c179-4ab9-adec-7ec1ebbd074b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.335592 Sep 15 09:00:34.163236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 286/600] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:33 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:34.434040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:34.434923 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:34.447324 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:34.447937 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:34.449176 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:34.449771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:34.464469 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:34.490034 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:34.514637 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:34.516541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:34.517222 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:34.518717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:34.748319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:34.761037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b30c4345-d725-4939-8867-5b142ee9e565 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.339848 Sep 15 09:00:34.762160 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 315/601] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:34 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:34.913961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:34.913961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ff097c83-4138-400c-9355-5e0cff4ba659 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.447983 Sep 15 09:00:34.913961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 287/602] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:34 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:34.969595 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:34.970243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:35.008036 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.008772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:35.009733 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.010412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:35.183425 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:35.185879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:35.203486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.203961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:35.204753 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.207190 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:35.338596 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:35.355354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:35.362288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:35.363494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6e564efb-3376-4740-b867-3ccdab0808ac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.403767 Sep 15 09:00:35.374880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 316/603] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:34 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:35.503625 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:35.513902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-32345d0c-a0d6-48a4-bcc9-ebdd3ef37c3d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.340915 Sep 15 09:00:35.514796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 288/604] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:35 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:35.786862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:35.788259 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:35.800589 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.801273 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:35.802909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.805012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:35.911622 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:35.912226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:35.934451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.938203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:35.940026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:35.942150 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:36.176281 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:36.200841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-edc0490b-cb36-4e19-98db-02e4e83935cb tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.426397 Sep 15 09:00:36.213137 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 317/605] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:35 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:36.301473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:36.312341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9992591b-c458-4a58-84b9-0b5150ccdde9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1724 microversion: 2.1 time: 0.409544 Sep 15 09:00:36.313975 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 289/606] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:35 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:36.388962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:36.389642 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:36.398756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:36.399489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:36.400518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:36.401153 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:36.536741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:36.537766 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:36.546279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:36.546861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:36.547753 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:36.548288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:36.654174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:36.678592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:36.693809 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:36.695647 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c130336b-2681-4b31-8588-f2f3e3063498 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.316009 Sep 15 09:00:36.699096 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 318/607] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:36 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:36.819137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:36.827863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-87ff3920-8b39-4d5e-9019-80dfd394c26d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.301069 Sep 15 09:00:36.828386 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 290/608] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:36 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:37.233326 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:37.239903 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:37.251985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:37.253024 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:37.253837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:37.254345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:37.336856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:37.351197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:37.373732 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:37.374225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:37.375041 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:37.375470 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:37.506392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:37.515939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cf8914c4-8e3c-469b-add1-e97a84eebdc5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.299283 Sep 15 09:00:37.526276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 319/609] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:37 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:37.630836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:37.640416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-235b3cca-b71a-4020-85d9-0277065fe0ee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1701 microversion: 2.1 time: 0.313535 Sep 15 09:00:37.651809 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 291/610] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:37 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1701 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:37.662608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f4ef75e1-6b57-4b49-bd38-70bf8e12c5dc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:37.670623 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4ef75e1-6b57-4b49-bd38-70bf8e12c5dc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:37.671561 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4ef75e1-6b57-4b49-bd38-70bf8e12c5dc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:37.734922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:37.734922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:37.741914 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:37.743158 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:37.743882 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:37.744426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:37.818454 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f4ef75e1-6b57-4b49-bd38-70bf8e12c5dc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Going to try to start instance {{(pid=89582) start /opt/stack/nova/nova/compute/api.py:2622}} Sep 15 09:00:38.015832 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:38.031300 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:38.053345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:38.055976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-013a3c73-bbc2-449d-951e-8667c940421a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.342782 Sep 15 09:00:38.056690 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 292/611] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:37 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:38.069024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:38.069544 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:38.090980 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:38.094782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:38.094782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:38.094782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:38.167335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f4ef75e1-6b57-4b49-bd38-70bf8e12c5dc tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 202 len: 0 microversion: 2.1 time: 0.510415 Sep 15 09:00:38.168928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 320/612] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:00:37 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:00:38.193126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:38.197645 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:38.209916 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:38.210169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:38.211643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:38.212143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:38.359287 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:38.369643 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-11447892-104a-49e0-90f6-30565ef14355 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.311569 Sep 15 09:00:38.370405 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 293/613] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:38 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:38.448862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:38.458020 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-90f38a24-c827-4ef0-9b4b-82aa901a830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.285855 Sep 15 09:00:38.458788 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 321/614] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:38 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:38.541700 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:38.542456 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:38.550155 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:38.550670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:38.551511 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:38.551942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:38.849211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:38.861863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4b091739-0cd8-4f0e-acb2-185270a3b543 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.332639 Sep 15 09:00:38.866121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 294/615] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:38 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:39.090527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:39.091561 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:39.100306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.101115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.101975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.102445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.345401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:39.361298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:39.369587 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:39.371187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d0180a7d-de29-42b0-b948-e30f8f22197c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.298949 Sep 15 09:00:39.374636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 322/616] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:39 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:39.404664 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:39.410257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:39.424654 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.425773 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.429712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.430640 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.491243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:39.491243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:39.533666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.534660 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.535632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.536000 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.853796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:39.865731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c2ce97dc-8952-4295-a62d-f28ee6cf1b35 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.481554 Sep 15 09:00:39.867975 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 295/617] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:39 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:39.875114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:39.881190 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-abed31c1-e934-4aea-9ceb-91eb2955f4f9 req-ad428572-5abc-4c8f-acf3-f7feea54863e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588ad70f-a4ba-41bd-98fc-3b3d3fd24904", "name": "network-vif-plugged", "status": "completed", "tag": "331f1df2-a0ed-4351-a544-34bd746e8e93"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:39.892353 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:39.892353 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:00:39.893765 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cdbe866c-3bcb-4a27-bb97-55c454caac5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.422271 Sep 15 09:00:39.895130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 323/618] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:39 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:39.912046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-abed31c1-e934-4aea-9ceb-91eb2955f4f9 req-ad428572-5abc-4c8f-acf3-f7feea54863e service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.912479 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-abed31c1-e934-4aea-9ceb-91eb2955f4f9 req-ad428572-5abc-4c8f-acf3-f7feea54863e service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.923158 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:39.924572 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:39.933789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.934555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.936123 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:39.936461 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-abed31c1-e934-4aea-9ceb-91eb2955f4f9 req-ad428572-5abc-4c8f-acf3-f7feea54863e service nova] Creating event network-vif-plugged:331f1df2-a0ed-4351-a544-34bd746e8e93 for instance 588ad70f-a4ba-41bd-98fc-3b3d3fd24904 on hv-cinder-80600 Sep 15 09:00:39.936726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:39.947329 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-abed31c1-e934-4aea-9ceb-91eb2955f4f9 req-ad428572-5abc-4c8f-acf3-f7feea54863e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077540 Sep 15 09:00:39.948273 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 296/619] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:40.156266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:40.164523 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9a648634-b0c7-4f53-aa44-9868d1253822 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.268479 Sep 15 09:00:40.165087 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 324/620] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:39 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:40.404777 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:40.406225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:40.417292 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:40.417862 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:40.419029 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:40.419551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:40.661982 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:40.680818 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:40.687599 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:40.689016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9191caca-a461-4cd3-b9a7-d95de11643c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.296498 Sep 15 09:00:40.700681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 297/621] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:40 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:40.891133 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:40.891873 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:40.904944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:40.906771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:40.906771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:40.907137 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:40.928811 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:40.929848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:40.938316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:40.940347 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:40.940347 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:40.940347 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:41.228997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:41.231321 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:41.240049 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-64a0a592-4a70-45c8-bb36-c3655e1095d7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.359965 Sep 15 09:00:41.240609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 325/622] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:40 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:41.262323 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:41.262474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fdf5a5fc-67bf-454d-800d-9d050b0b6fec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.334773 Sep 15 09:00:41.263415 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 298/623] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:40 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:41.275901 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:41.300611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:41.302508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:41.304042 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:41.304042 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:41.551941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:41.560578 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2f0ae73f-c0ad-48a0-819a-dedbcc3cf23f tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.318904 Sep 15 09:00:41.562899 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 326/624] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:41 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:41.713951 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:41.715308 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:41.723757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:41.723757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:41.724512 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:41.724909 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:41.973037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:41.987836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:41.995016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:41.996165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-87eef2eb-50bb-45b8-9c74-33afb80a39e1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.292121 Sep 15 09:00:41.996689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 299/625] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:41 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:42.263345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:42.263948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:42.274878 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:42.275552 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:42.276493 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:42.277084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:42.286707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:42.287470 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:42.295608 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:42.296453 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:42.297422 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:42.297949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:42.534598 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:42.549115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8739e4e3-09a0-439f-a348-1cd0b0277b18 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.295620 Sep 15 09:00:42.560037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 327/626] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:42 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:42.587283 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:42.599378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:42.599557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-685a6715-f9cc-468f-9115-4c52fa8d4fa4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.322787 Sep 15 09:00:42.600462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:42.602218 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 300/627] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:42 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:42.609019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:42.612177 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:42.612526 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:42.612955 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:42.907288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:42.916564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-20fbf7c7-0990-4a48-ad95-1cc4d41b9283 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.330806 Sep 15 09:00:42.926413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 328/628] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:42 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:43.020722 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:43.021341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:43.036822 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.037373 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.038445 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.039005 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.272464 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:43.287688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:43.296591 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:43.297856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-91c2d7a0-93f1-496d-86a6-02b294067f34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.287819 Sep 15 09:00:43.304953 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 301/629] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:43 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:43.575630 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:43.580401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:43.585919 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.586632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.587807 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.588429 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.627061 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:43.627816 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:43.644374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.644956 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.645827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.646399 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.927527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:43.936820 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4f3e3ed2-3586-4983-b808-ff03eb665e4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.373595 Sep 15 09:00:43.946272 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 329/630] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:43 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:43.947938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:43.948475 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:43.956275 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.956734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.957551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:43.957984 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:43.960828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:43.974121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-75f2b2b7-ae5e-4fbf-abac-1ba36e5597ed tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.359832 Sep 15 09:00:43.975373 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 302/631] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:43 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:44.193904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:44.203185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-02428724-0997-4392-be80-18c93cf5286e tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.264834 Sep 15 09:00:44.203938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 330/632] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:43 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:44.321904 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:44.325161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:44.335340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:44.335713 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:44.336627 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:44.337060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:44.624164 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:44.638253 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:44.644725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:44.645861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4f844f0a-e831-4db5-961f-310d88f78744 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.333838 Sep 15 09:00:44.646422 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 303/633] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:44 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:44.958717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:44.964249 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:44.967427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:44.967863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:44.968650 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:44.969084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:45.003019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:45.007964 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:45.017682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:45.018153 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:45.018950 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:45.019370 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:45.345357 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:45.347949 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:45.359345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e2d7140b-7327-4d58-a93b-36bf11bf9542 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.371196 Sep 15 09:00:45.365340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 304/634] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:44 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:45.365459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6b3a14df-5655-48b0-8161-2b07a31d2acd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.412020 Sep 15 09:00:45.365459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 331/635] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:44 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:45.370376 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:45.370986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:45.378593 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:45.379039 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:45.381050 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:45.381700 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:45.675735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:45.676339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:45.687165 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:45.687651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:45.688426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:45.688849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:45.843679 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:45.852771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6f10104e-8875-4d4b-b6db-5f380adfc0a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.491866 Sep 15 09:00:45.853602 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 305/636] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:45 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:45.905274 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:45.920017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:45.926330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:45.930170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0ae409c1-7135-479e-8ff9-453f65727486 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.264216 Sep 15 09:00:45.930170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 332/637] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:45 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:46.382633 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:46.384072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:46.389686 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:46.390318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:46.393095 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.393785 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:46.394878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.395518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:46.398213 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.398726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:46.399555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.400101 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:46.655598 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:46.667205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dcfcef52-0bb4-46af-a6f4-eb2643bc7ade tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.293767 Sep 15 09:00:46.682582 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 306/638] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:46 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:46.696243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:46.705866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6ea8a291-8ca0-401a-9491-3006fc1e7938 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.330583 Sep 15 09:00:46.706425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 333/639] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:46 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:46.885213 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:46.885959 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:46.894074 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.894576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:46.895591 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.896073 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:46.952135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:46.959067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:46.995396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.996563 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:46.997786 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:46.998660 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:47.133978 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:47.142769 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cf75b8a4-46da-4a45-8f99-f35c7460ef70 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.277418 Sep 15 09:00:47.152309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 307/640] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:46 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:47.257959 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:47.287538 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:47.313412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:47.313412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1019d73a-52b3-4495-bd5d-872519cbb69c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.370864 Sep 15 09:00:47.323689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 334/641] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:46 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:47.696781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:47.697936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:47.720899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:47.722754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:47.725031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:47.726894 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:47.729070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:47.729682 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:47.764448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:47.764878 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:47.765657 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:47.766199 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:48.019523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:48.029774 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-923d9655-ba34-401d-a967-46493535705c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1710 microversion: 2.1 time: 0.348398 Sep 15 09:00:48.030351 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 308/642] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:47 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1710 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:48.157037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:48.168734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ef2875c5-6aff-4977-95e5-5391651fd6cc tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.449494 Sep 15 09:00:48.170064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 335/643] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:47 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:00:48.176672 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:48.177780 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:48.185741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:48.186289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:48.187188 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:48.187684 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:48.337857 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:48.339057 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:48.350361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:48.351823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:48.352783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:48.353326 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:48.435341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:48.444999 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c211dbf1-a860-49e9-937f-e2f95b6592a2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1317 microversion: 2.1 time: 0.288752 Sep 15 09:00:48.445893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 309/644] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:48 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:48.615927 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:48.631758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:48.638944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:48.640305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-777df0a6-d57c-4137-ba68-8f2b406e64a5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.313907 Sep 15 09:00:48.640904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 336/645] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:48 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:49.073079 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:49.073712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:49.091437 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.091877 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.092658 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.093094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.197620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:49.199005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:49.211250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.229467 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.229467 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.229467 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.367473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:49.377542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d52fb64f-eecf-4ac3-b99c-b5fd7ce3d3a5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1714 microversion: 2.1 time: 0.333568 Sep 15 09:00:49.389438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 310/646] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:49 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1714 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:49.467789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:49.468393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:49.470995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:49.477241 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.479103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.479103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.479103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.490199 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f8b4de3e-1d55-4f41-bc8d-f6a0db513ca9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.303766 Sep 15 09:00:49.490199 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 337/647] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:49 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:49.664573 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:49.665185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:49.672930 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.674254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.674474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:49.674949 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:49.726577 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:49.739082 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5f2be6c4-0170-4f3e-992a-e09eaf9eda0a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1506 microversion: 2.1 time: 0.280881 Sep 15 09:00:49.743895 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 311/648] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:49 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:49.907379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:49.927344 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:49.942383 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:49.945738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1ca5cc4e-b4a5-435f-95a8-36ce6547db0f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.291474 Sep 15 09:00:49.956302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 338/649] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:49 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:50.514397 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:50.516085 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:50.526367 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:50.527023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:50.528132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:50.528733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:50.784031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:50.798501 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-62eb411c-2d3a-48b6-b430-2e1476deea4b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.296173 Sep 15 09:00:50.799377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 312/650] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:50 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:50.977043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:50.978857 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:50.987143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:50.988360 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:50.989364 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:50.989874 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:51.281047 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:51.308627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:51.326165 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:51.327308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-86616dec-3d38-430b-b653-f5e9d2ef5791 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.367365 Sep 15 09:00:51.330126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 339/651] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:50 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:51.821345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:51.821954 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:51.829102 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:51.829542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:51.830339 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:51.830769 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:52.044714 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:52.055525 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-66c8bac6-357c-47c7-ac0c-d268f269e8bf tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.243032 Sep 15 09:00:52.065927 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 313/652] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:51 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:52.351188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:52.354563 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:52.359329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:52.360011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:52.360949 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:52.361543 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:52.658302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:52.674438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:52.681538 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:52.683062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7f15ddbe-c3dd-48f5-a33d-232dbed2a6fe tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.341267 Sep 15 09:00:52.691080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 340/653] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:52 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:00:52.847143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0105496f-1e8f-4476-812d-2ef560038a21 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11b772ac-aac5-4711-b22c-7cdbce9c3991"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:52.848267 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0105496f-1e8f-4476-812d-2ef560038a21 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:52.856717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0105496f-1e8f-4476-812d-2ef560038a21 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:52.857052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0105496f-1e8f-4476-812d-2ef560038a21 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:52.858051 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0105496f-1e8f-4476-812d-2ef560038a21 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:52.858518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0105496f-1e8f-4476-812d-2ef560038a21 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:53.082296 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:53.082969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:53.092339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:53.092889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:53.093834 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:53.094300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:53.399766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:53.413375 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b558927f-c6b1-4f4f-b505-cc2157b71ccb tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.345438 Sep 15 09:00:53.423920 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 341/654] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:53 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:53.711229 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:53.714332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:53.729260 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:53.730872 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:53.735022 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:53.735495 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:53.875074 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0105496f-1e8f-4476-812d-2ef560038a21 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "POST /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036973 Sep 15 09:00:53.882537 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 314/655] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:00:52 2021] POST /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:00:54.020868 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:54.035970 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:54.042585 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:54.044735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-db4038dc-bb7d-4f7a-bfac-27ed84af43d3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1739 microversion: 2.20 time: 0.345351 Sep 15 09:00:54.045260 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 342/656] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:53 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:54.438871 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:54.439776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:54.448568 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:54.449005 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:54.449768 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:54.450246 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:54.666523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:54.675548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9b163e8d-964d-466e-b295-e48b4b6207e7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.248850 Sep 15 09:00:54.676469 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 315/657] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:54 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:55.069773 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:55.070398 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:55.077759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:55.078222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:55.078984 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:55.079556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:55.394466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:55.409024 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:55.416032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:55.417422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6753c489-9d23-455e-8d70-9c82ae6216ab tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1721 microversion: 2.20 time: 0.357424 Sep 15 09:00:55.418571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 343/658] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:55 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:55.704759 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:55.708197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:55.713031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:55.713467 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:55.714255 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:55.714684 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:56.240563 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:56.257122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-295a7862-f7eb-4955-aac5-b1a571cdc7b2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.565329 Sep 15 09:00:56.257924 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 316/659] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:55 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:56.456859 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:56.460204 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:56.472031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:56.473430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:56.474518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:56.476039 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:56.700834 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:56.715810 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:56.722313 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:56.723462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-24358433-6586-42c0-a0e8-29506ad00cfd tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1721 microversion: 2.20 time: 0.290262 Sep 15 09:00:56.723983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 344/660] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:56 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:57.281438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:57.282040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:57.291033 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:57.291674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:57.292462 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:57.292903 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:57.546078 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:57.556310 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-25d21983-3620-4b9a-be32-2221ca913d07 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.286070 Sep 15 09:00:57.560031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 317/661] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:57 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:57.750031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:57.750965 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:57.765299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:57.765887 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:57.766884 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:57.772378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:57.993576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:58.009688 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:58.016448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:58.017935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8a5a6d1e-630a-4fdc-85d1-b159e8d1dde5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1721 microversion: 2.20 time: 0.279542 Sep 15 09:00:58.029686 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 345/662] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:57 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:58.172919 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-85b7d15b-ea87-43b0-b31d-46eaaded4e6f tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:58.175143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-85b7d15b-ea87-43b0-b31d-46eaaded4e6f tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:58.184488 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85b7d15b-ea87-43b0-b31d-46eaaded4e6f tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:58.186731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85b7d15b-ea87-43b0-b31d-46eaaded4e6f tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:58.186731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85b7d15b-ea87-43b0-b31d-46eaaded4e6f tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:58.186731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85b7d15b-ea87-43b0-b31d-46eaaded4e6f tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:58.581741 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:58.587301 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:58.603275 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:58.606165 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:58.607150 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:58.608844 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:58.673579 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-85b7d15b-ea87-43b0-b31d-46eaaded4e6f tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06/os-volume_attachments/1891ea11-d3e1-4195-9be2-bd5acae42903" status: 202 len: 0 microversion: 2.1 time: 0.531327 Sep 15 09:00:58.691922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 318/663] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:00:58 2021] DELETE /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06/os-volume_attachments/1891ea11-d3e1-4195-9be2-bd5acae42903 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:00:58.976175 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:58.986871 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9fb8b035-e274-4159-b13b-9978d8aadaae tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.414268 Sep 15 09:00:58.997358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 346/664] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:58 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:00:59.043193 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:00:59.043867 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:00:59.051670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:59.052112 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:59.052874 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:59.053297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:59.300943 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:59.317893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:59.324920 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:00:59.326116 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b7645712-d39f-4bb1-9ac1-5ef67554a0f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1721 microversion: 2.20 time: 0.293264 Sep 15 09:00:59.327123 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 319/665] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:00:59 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:00:59.649714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-38497c14-8c72-40cb-b5bc-da869288712b req-fa152267-f754-4323-8e57-3e926bc6b3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba14ca7-eb88-437e-9c49-5101925f639b", "name": "network-vif-unplugged", "status": "completed", "tag": "314b817f-9c79-46cf-a672-a625eea4af10"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:00:59.657159 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:00:59.657159 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:00:59.666349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-38497c14-8c72-40cb-b5bc-da869288712b req-fa152267-f754-4323-8e57-3e926bc6b3be service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:00:59.669495 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-38497c14-8c72-40cb-b5bc-da869288712b req-fa152267-f754-4323-8e57-3e926bc6b3be service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:00:59.683247 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-38497c14-8c72-40cb-b5bc-da869288712b req-fa152267-f754-4323-8e57-3e926bc6b3be service nova] Creating event network-vif-unplugged:314b817f-9c79-46cf-a672-a625eea4af10 for instance 5ba14ca7-eb88-437e-9c49-5101925f639b on hv-cinder-80600 Sep 15 09:00:59.688395 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-38497c14-8c72-40cb-b5bc-da869288712b req-fa152267-f754-4323-8e57-3e926bc6b3be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051933 Sep 15 09:00:59.688918 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 347/666] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:00:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:00.010157 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:00.011509 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:00.019334 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:00.020057 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:00.021079 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:00.021833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:00.323214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:00.332974 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fb7ca4ca-8780-414d-85e1-2ce120b383c1 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.332368 Sep 15 09:01:00.334150 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 320/667] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:00:59 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:00.351177 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:00.353248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:00.360835 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:00.361567 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:00.362375 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:00.362967 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:00.611331 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:00.627182 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:00.635831 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:00.637294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3e2d4ac1-e5f7-4f46-98a8-cde3a037d3ae tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1664 microversion: 2.20 time: 0.296291 Sep 15 09:01:00.640742 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 348/668] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:00 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1664 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:01:00.664503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-95e26f83-5365-44d4-b419-8cbdcc3e1d4e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3aa25089-8477-4d91-9056-df91fe414c51"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:00.665659 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-95e26f83-5365-44d4-b419-8cbdcc3e1d4e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:00.673965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-95e26f83-5365-44d4-b419-8cbdcc3e1d4e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:00.674439 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-95e26f83-5365-44d4-b419-8cbdcc3e1d4e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:00.675212 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-95e26f83-5365-44d4-b419-8cbdcc3e1d4e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:00.675698 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-95e26f83-5365-44d4-b419-8cbdcc3e1d4e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:01.356137 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:01.356883 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:01.364748 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:01.365583 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:01.376509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:01.376962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:01.615304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:01.624463 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e3072050-ab92-4546-a4cf-2719a2a60ae6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.278083 Sep 15 09:01:01.624990 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 349/669] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:01 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:02.056323 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-95e26f83-5365-44d4-b419-8cbdcc3e1d4e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.401706 Sep 15 09:01:02.057167 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 321/670] 10.222.0.39 () {62 vars in 1364 bytes} [Wed Sep 15 09:01:00 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments => generated 188 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:01:02.328670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b1ab0ffb-0eea-4d9d-b031-8a4cb5424d59 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:02.329378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b1ab0ffb-0eea-4d9d-b031-8a4cb5424d59 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:02.338474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ab0ffb-0eea-4d9d-b031-8a4cb5424d59 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:02.338963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ab0ffb-0eea-4d9d-b031-8a4cb5424d59 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:02.339839 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ab0ffb-0eea-4d9d-b031-8a4cb5424d59 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:02.340591 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ab0ffb-0eea-4d9d-b031-8a4cb5424d59 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:02.647345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:02.647967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:02.659810 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:02.660641 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:02.661433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:02.662000 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:02.855824 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b1ab0ffb-0eea-4d9d-b031-8a4cb5424d59 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action" status: 202 len: 0 microversion: 2.20 time: 0.540580 Sep 15 09:01:02.857236 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 350/671] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:01:02 2021] POST /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:01:02.873744 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:02.874641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:02.883169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:02.883791 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:02.884876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:02.885402 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:02.924019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:02.949946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bc3f83b9-7f67-4ece-8a8d-541e286b4590 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.312086 Sep 15 09:01:02.979689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 322/672] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:02 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:03.147168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:03.185963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:03.193510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:03.204567 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5e738da4-6a1f-43ff-b587-4285019a32f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1750 microversion: 2.20 time: 0.343676 Sep 15 09:01:03.205557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 351/673] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:02 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1750 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:03.687611 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-89a062a0-a6bf-43dc-8e6f-78e218018b8b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:03.691893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-89a062a0-a6bf-43dc-8e6f-78e218018b8b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:03.707443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-89a062a0-a6bf-43dc-8e6f-78e218018b8b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:03.707967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-89a062a0-a6bf-43dc-8e6f-78e218018b8b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:03.712231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-89a062a0-a6bf-43dc-8e6f-78e218018b8b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:03.712686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-89a062a0-a6bf-43dc-8e6f-78e218018b8b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.000653 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:04.009301 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:04.022472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.023657 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.024624 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.025212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.210685 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-89a062a0-a6bf-43dc-8e6f-78e218018b8b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "DELETE /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments/11b772ac-aac5-4711-b22c-7cdbce9c3991" status: 202 len: 0 microversion: 2.1 time: 0.532609 Sep 15 09:01:04.214624 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 323/674] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:01:03 2021] DELETE /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments/11b772ac-aac5-4711-b22c-7cdbce9c3991 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 09:01:04.238609 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5e6df13a-1bab-4c59-a6a2-e989757adaaa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:04.240070 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5e6df13a-1bab-4c59-a6a2-e989757adaaa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:04.250068 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e6df13a-1bab-4c59-a6a2-e989757adaaa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.250812 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e6df13a-1bab-4c59-a6a2-e989757adaaa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.252263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e6df13a-1bab-4c59-a6a2-e989757adaaa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.252645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e6df13a-1bab-4c59-a6a2-e989757adaaa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.329212 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5e6df13a-1bab-4c59-a6a2-e989757adaaa tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113098 Sep 15 09:01:04.329777 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 324/675] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:01:04 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:04.345330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:04.345471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:04.346051 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:04.355839 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.356306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.357096 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.357543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.359484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-99df5726-14b0-4b24-b2b9-4a3adbb8a9ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.391094 Sep 15 09:01:04.360445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 352/676] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:03 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:04.686026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:04.709727 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:04.710324 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:04.714032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:04.718461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.722135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.722135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:04.722135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:04.722401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:04.722401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-244e660b-edb5-481a-8f49-c28bf4a6ee7e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1750 microversion: 2.20 time: 0.386977 Sep 15 09:01:04.722401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 325/677] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:04 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1750 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:04.941694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:01:05.278988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3ccbce22-f1ff-4acc-9343-7426601a0307 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 204 len: 0 microversion: 2.1 time: 0.582986 Sep 15 09:01:05.280581 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 353/678] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:01:04 2021] DELETE /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 09:01:05.303836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:05.304853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:05.312498 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.313240 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.314112 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.314772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.360013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d885dfb1-bf45-479b-9dd3-58289759739c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:05.361492 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d885dfb1-bf45-479b-9dd3-58289759739c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:05.376146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d885dfb1-bf45-479b-9dd3-58289759739c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.376902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d885dfb1-bf45-479b-9dd3-58289759739c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.378230 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d885dfb1-bf45-479b-9dd3-58289759739c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.378971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d885dfb1-bf45-479b-9dd3-58289759739c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.495496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d885dfb1-bf45-479b-9dd3-58289759739c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157333 Sep 15 09:01:05.497912 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 354/679] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:01:05 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:05.509401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:05.510054 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:05.517690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.518172 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.519159 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.519786 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.732396 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:05.742531 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-64fe4db9-d138-4e80-a383-f6ccd95e9187 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1514 microversion: 2.1 time: 0.447751 Sep 15 09:01:05.743184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 326/680] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:05 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:05.753560 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:05.754512 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:05.762880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.763382 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.764398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:05.764938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:05.828964 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:05.868592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7da676fe-9bbd-41b4-a804-c4b7e28aaab0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.370996 Sep 15 09:01:05.877899 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 355/681] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:05 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:06.087949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:06.112778 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:06.120019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:06.121458 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e1125544-1461-4a68-a333-57e41f567f84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1752 microversion: 2.20 time: 0.376877 Sep 15 09:01:06.122619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 327/682] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:05 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1752 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:06.527521 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cae634ae-24d1-4d6e-95be-8d0f1bec3d93 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:06.530805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cae634ae-24d1-4d6e-95be-8d0f1bec3d93 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:06.540690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cae634ae-24d1-4d6e-95be-8d0f1bec3d93 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:06.541126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cae634ae-24d1-4d6e-95be-8d0f1bec3d93 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:06.541907 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cae634ae-24d1-4d6e-95be-8d0f1bec3d93 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:06.542942 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cae634ae-24d1-4d6e-95be-8d0f1bec3d93 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:06.626608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cae634ae-24d1-4d6e-95be-8d0f1bec3d93 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115341 Sep 15 09:01:06.627510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 356/683] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:01:06 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:01:06.765500 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:06.766517 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:06.773698 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:06.774332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:06.775222 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:06.775708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:06.891847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:06.892508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:06.900473 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:06.900914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:06.901823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:06.902438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:07.003146 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:07.013256 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f2d1b60f-3e6e-4555-9bc8-9c947b148c19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1514 microversion: 2.1 time: 0.257591 Sep 15 09:01:07.018378 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 328/684] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:06 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:07.151421 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:07.152217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:07.168955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:07.168955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:07.168955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:07.168955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:07.211469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:07.220586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6d50331d-f160-4f1a-9afd-fc342d66aaf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.339548 Sep 15 09:01:07.221343 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 357/685] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:06 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:07.444966 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:07.458834 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:07.465436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:07.466536 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-14b9c294-87fb-4393-9f77-44c7dc0740b9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1752 microversion: 2.20 time: 0.326859 Sep 15 09:01:07.467443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 329/686] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:07 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1752 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:01:08.035978 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:08.037341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:08.047764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.048452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.049547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.050252 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.128917 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:08.134277 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:08.150792 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.152114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.156828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.157549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.268840 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:01:08.383379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:08.391993 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-62f89555-619c-45cd-bfed-944c3dceffa6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1514 microversion: 2.1 time: 0.365075 Sep 15 09:01:08.394358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 358/687] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:08 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1514 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:08.403884 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:08.404491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:08.411717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.413166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.413166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.413435 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.580391 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7d483bbc-df13-4969-a33b-d0b21b719737 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "DELETE /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 204 len: 0 microversion: 2.1 time: 0.460974 Sep 15 09:01:08.581057 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 330/688] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:01:08 2021] DELETE /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 09:01:08.592990 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:08.593893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:08.603814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.604905 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.606146 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.606649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.647548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:08.657959 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-694f5846-ef43-4dd3-9d31-207b757de50d tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.263975 Sep 15 09:01:08.667697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 359/689] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:08 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:08.676242 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:08.676858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:08.686627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.687074 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.687850 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:08.688277 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:08.908100 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:08.917312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ebb26ad4-37e4-45dd-803c-e6fa2d9210e4 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1512 microversion: 2.1 time: 0.257280 Sep 15 09:01:08.918456 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 360/690] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:08 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:09.187039 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:09.206064 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:09.218676 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:09.231761 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-762bc6c5-0762-4aa7-9c30-ef1f49d627bc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1752 microversion: 2.20 time: 0.638335 Sep 15 09:01:09.233383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 331/691] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:08 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1752 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:09.415078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:09.415767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:09.422851 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:09.423291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:09.424043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:09.424466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:09.460627 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-e3a69eca-fa97-4d32-89a2-0488579471ff req-e7d0242c-833b-4249-8790-94319f2f5448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d9451c-a5e9-4981-b5d2-2d2b2984ef06", "name": "network-vif-deleted", "tag": "e49b8f0c-352a-44c7-977f-0d7124307c06"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:09.467982 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:09.467982 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:01:09.478661 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-e3a69eca-fa97-4d32-89a2-0488579471ff req-e7d0242c-833b-4249-8790-94319f2f5448 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:09.479473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-e3a69eca-fa97-4d32-89a2-0488579471ff req-e7d0242c-833b-4249-8790-94319f2f5448 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:09.502048 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-e3a69eca-fa97-4d32-89a2-0488579471ff req-e7d0242c-833b-4249-8790-94319f2f5448 service nova] Creating event network-vif-deleted:e49b8f0c-352a-44c7-977f-0d7124307c06 for instance 33d9451c-a5e9-4981-b5d2-2d2b2984ef06 on hv-cinder-80600 Sep 15 09:01:09.509161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-e3a69eca-fa97-4d32-89a2-0488579471ff req-e7d0242c-833b-4249-8790-94319f2f5448 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058155 Sep 15 09:01:09.511703 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 332/692] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:01:09.554481 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:09.563192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9be0cfef-2320-4ea4-9392-18a9d7c3fbde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1472 microversion: 2.1 time: 0.158313 Sep 15 09:01:09.563718 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 361/693] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:09 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:09.681114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:09.681771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:09.689266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:09.692254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:09.692254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:09.692254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:09.942574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:09.942574 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:09.971232 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:09.971689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:09.972605 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:09.973294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:10.135901 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:10.144848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c313fe1d-b42b-4f2e-a3be-8a4495d03816 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1567 microversion: 2.1 time: 0.473137 Sep 15 09:01:10.153781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 333/694] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:09 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1567 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:10.217115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:10.225094 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d0e53d27-b1bc-4631-8a2f-2994bab711d8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1512 microversion: 2.1 time: 0.292523 Sep 15 09:01:10.225616 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 362/695] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:09 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:10.244871 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:10.245474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:10.252844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:10.253275 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:10.257573 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:10.257573 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:10.462638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:10.476293 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:10.482544 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:10.486912 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ac2523aa-bb87-439d-8a57-59f696cd1c0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1752 microversion: 2.20 time: 0.248553 Sep 15 09:01:10.486912 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 334/696] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:10 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:10.585357 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:10.585976 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:10.593272 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:10.593716 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:10.594583 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:10.594927 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:10.675136 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:10.675566 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:10.676017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lazy-loading 'fault' on Instance uuid 33d9451c-a5e9-4981-b5d2-2d2b2984ef06 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:10.740902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:10.749671 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-82194062-acf9-4ffd-9771-a551591a9b95 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 200 len: 1309 microversion: 2.1 time: 0.173481 Sep 15 09:01:10.750217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 363/697] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:10 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 1309 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:11.168693 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:11.169304 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:11.176751 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.177270 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.178045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.178505 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.247152 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:11.248138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:11.255535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.256300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.257232 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.258230 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.395496 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:11.406392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-79fef7f8-16e7-4bc6-8311-2f9d5a198e7b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1547 microversion: 2.1 time: 0.247742 Sep 15 09:01:11.422231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 335/698] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:11 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1547 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:11.434650 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:11.435406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:11.445143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.446885 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.449703 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.450562 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.479030 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:11.491243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e00893b2-4ebc-4e52-80c9-a956247e7a72 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1512 microversion: 2.1 time: 0.254400 Sep 15 09:01:11.502023 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 364/699] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:11 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:11.513354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:11.513927 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:11.521254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.521776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.522512 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.523114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.658401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] HTTP exception thrown: Cannot 'detach_volume' instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 while it is in vm_state rescued Sep 15 09:01:11.658401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Returning 409 to user: Cannot 'detach_volume' instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 while it is in vm_state rescued {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:01:11.658401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5f2d1b02-f677-4889-ab0c-b477dee742b7 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "DELETE /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments/bcfcbc6e-ef7a-4445-81c9-2532c04a33d6" status: 409 len: 152 microversion: 2.1 time: 0.228291 Sep 15 09:01:11.658401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 336/700] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:01:11 2021] DELETE /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments/bcfcbc6e-ef7a-4445-81c9-2532c04a33d6 => generated 152 bytes in 230 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 09:01:11.668895 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-11f9cad8-bc6d-4264-98db-1e53392a9626 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:11.669444 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-11f9cad8-bc6d-4264-98db-1e53392a9626 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:11.677802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11f9cad8-bc6d-4264-98db-1e53392a9626 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.678356 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11f9cad8-bc6d-4264-98db-1e53392a9626 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.679274 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11f9cad8-bc6d-4264-98db-1e53392a9626 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.679549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-11f9cad8-bc6d-4264-98db-1e53392a9626 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.791612 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:11.810730 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:11.817474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:11.818680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2a68c115-3add-4cc0-ada3-737a8b243caf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.315378 Sep 15 09:01:11.823725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 365/701] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:11 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:11.832304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:11.833122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: 33d9451c-a5e9-4981-b5d2-2d2b2984ef06] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:11.842710 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.843304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.844279 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:11.844929 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:11.898254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] HTTP exception thrown: Instance 33d9451c-a5e9-4981-b5d2-2d2b2984ef06 could not be found. Sep 15 09:01:11.899274 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Returning 404 to user: Instance 33d9451c-a5e9-4981-b5d2-2d2b2984ef06 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:01:11.900467 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f4b01ba7-fde9-45fd-aea1-9fdc057dbbbe tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06" status: 404 len: 111 microversion: 2.1 time: 0.079956 Sep 15 09:01:11.901392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 366/702] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:11 2021] GET /compute/v2.1/servers/33d9451c-a5e9-4981-b5d2-2d2b2984ef06 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:01:12.008572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-11f9cad8-bc6d-4264-98db-1e53392a9626 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action" status: 202 len: 0 microversion: 2.1 time: 0.351299 Sep 15 09:01:12.010344 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 337/703] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:01:11 2021] POST /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 09:01:12.028384 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:12.029212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:12.036891 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:12.037334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:12.038325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:12.038764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:12.273240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:12.282990 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c2b58c6a-af42-434e-b78f-62e5d6c4f71f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.268596 Sep 15 09:01:12.284031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 367/704] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:12 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:12.523853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:12.529545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:12.575012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:12.576999 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:12.579113 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:12.579674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:12.844955 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-2fa6b92c-68cc-4cc2-af6a-d3bf44bd76e4 req-82417208-04cf-4352-acbd-0fcd3ee19342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588ad70f-a4ba-41bd-98fc-3b3d3fd24904", "name": "network-vif-deleted", "tag": "331f1df2-a0ed-4351-a544-34bd746e8e93"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:12.862551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:12.862551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:01:12.883175 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-2fa6b92c-68cc-4cc2-af6a-d3bf44bd76e4 req-82417208-04cf-4352-acbd-0fcd3ee19342 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:12.883682 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-2fa6b92c-68cc-4cc2-af6a-d3bf44bd76e4 req-82417208-04cf-4352-acbd-0fcd3ee19342 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:12.925987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-2fa6b92c-68cc-4cc2-af6a-d3bf44bd76e4 req-82417208-04cf-4352-acbd-0fcd3ee19342 service nova] Creating event network-vif-deleted:331f1df2-a0ed-4351-a544-34bd746e8e93 for instance 588ad70f-a4ba-41bd-98fc-3b3d3fd24904 on hv-cinder-80600 Sep 15 09:01:12.937691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-2fa6b92c-68cc-4cc2-af6a-d3bf44bd76e4 req-82417208-04cf-4352-acbd-0fcd3ee19342 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104897 Sep 15 09:01:12.940948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 368/705] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:01:12.956902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:12.957626 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:12.967194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:12.967869 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:12.968781 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:12.969211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:13.081091 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:13.094555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3b1b60d5-3743-4dd7-b30a-189e0e153685 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.590004 Sep 15 09:01:13.105512 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 338/706] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:12 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:13.312013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:13.312691 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:13.330280 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:13.330638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:13.331864 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:13.333487 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:13.379712 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:13.405912 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:13.412641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:13.413944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-19ead898-49f1-4921-b090-8cf196c1a409 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.470834 Sep 15 09:01:13.425941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 369/707] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:12 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:13.866246 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:13.875790 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3d3870d3-1905-469f-a821-4d60c25cd0e8 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.578751 Sep 15 09:01:13.876313 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 339/708] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:13 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:14.117608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:14.118278 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:14.126188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:14.126633 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:14.127400 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:14.128021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:14.254360 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:14.262604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6b60f69a-07ea-4de6-8c61-f6bb6676a553 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.155001 Sep 15 09:01:14.271960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 370/709] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:14 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:14.466232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:14.466232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:14.466232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:14.466232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:14.466945 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:14.466945 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:14.679562 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:14.694739 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:14.701500 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:14.702642 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7c7d655e-6b63-403b-aa58-33f714f0af02 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.271490 Sep 15 09:01:14.703355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 340/710] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:14 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:14.901635 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:14.903026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:14.909616 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:14.910064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:14.910884 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:14.911314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:15.152805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:15.193738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a29db43d-00da-4dcb-b957-4259cbb9f278 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.305155 Sep 15 09:01:15.194485 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 371/711] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:14 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:15.285717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:15.286476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:15.293961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:15.294436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:15.295203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:15.295625 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:15.422372 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:15.431900 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-176f92c2-ef79-4201-855e-7ea5e0476521 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.156132 Sep 15 09:01:15.437104 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 341/712] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:15 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:15.726470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:15.730907 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:15.735898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:15.736350 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:15.737124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:15.737556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:15.967254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:15.981793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:15.988713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:15.989946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-10dc04ee-9c20-4f58-a75f-f4f42d5dc63d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.272926 Sep 15 09:01:15.990606 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 372/713] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:15 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:16.251416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:16.251416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:16.251416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:16.251416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:16.252103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:16.252103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:16.455845 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:16.456468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:16.464449 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:16.464665 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:16.465151 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:16.465665 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:16.466108 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:16.474022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b753cda4-d8b4-4457-8ff5-d8988c7765ca tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.258776 Sep 15 09:01:16.474605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 342/714] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:16 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:16.622570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:16.622570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cc801838-bda6-4234-892b-7b4fd9d45db1 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.175241 Sep 15 09:01:16.622570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 373/715] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:16 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:17.013558 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:17.014196 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:17.021658 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:17.022119 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:17.022910 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:17.023345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:17.269695 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:17.289046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:17.296923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:17.298604 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ccf49e42-8fd8-4914-879c-bb2bd774b59d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.294510 Sep 15 09:01:17.299298 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 343/716] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:17 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:17.496066 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:17.496877 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:17.504770 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:17.505209 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:17.505971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:17.506416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:17.656334 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:17.656845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:17.669054 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:17.669791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:17.670791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:17.671380 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:17.784203 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:17.795484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8895a8a4-3207-4521-9e43-9b86a160c15c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.308755 Sep 15 09:01:17.796020 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 374/717] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:17 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:17.838318 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:17.848471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-425d3d91-c191-4473-8319-5040df5d2a63 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.213810 Sep 15 09:01:17.853446 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 344/718] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:17 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:18.331420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:18.332147 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:18.339560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:18.339993 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:18.340759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:18.341184 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:18.562494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:18.576514 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:18.582901 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:18.584338 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-69f07b07-5c31-4fc3-a39b-344645237a67 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.263312 Sep 15 09:01:18.584905 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 375/719] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:18 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:01:18.817168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:18.817838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:18.825579 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:18.832499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:18.832499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:18.832499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:18.877030 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:18.879940 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:18.893902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:18.894746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:18.895969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:18.896656 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:19.135510 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:19.147961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:19.166783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cb42bc9c-778f-4889-bcd4-7d705595b735 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.297519 Sep 15 09:01:19.168342 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 376/720] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:18 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:19.172067 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8629967f-d516-4f6e-911d-b61bc1ea4877 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.358796 Sep 15 09:01:19.172835 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 345/721] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:18 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:19.610434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:19.611898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:19.623536 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:19.625657 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:19.626661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:19.627278 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:19.864798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:19.874474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:19.880997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:19.882409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-af185e68-3046-4259-8e4d-c4c5d784fead tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.282838 Sep 15 09:01:19.886155 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 377/722] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:19 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:20.194693 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:20.195996 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:20.203533 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:20.204276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:20.205055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:20.205484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:20.205894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:20.206515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:20.214459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:20.214909 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:20.228436 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:20.228946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:20.366414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:20.375859 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7f04a18c-a413-4d08-b042-9d1125957acc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.183571 Sep 15 09:01:20.376923 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 378/723] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:20 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:20.452711 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:20.462552 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-03f1496a-59dd-4f36-8f56-40a7af47c656 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.277656 Sep 15 09:01:20.463104 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 346/724] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:20 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:20.906470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:20.907099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:20.914820 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:20.915201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:20.915978 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:20.916410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:21.184491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:21.198705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:21.204919 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:21.206060 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d6cae469-c59b-4652-a47e-8e034ab7c7fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.309273 Sep 15 09:01:21.210124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 379/725] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:20 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:01:21.397670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:21.398470 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:21.406392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:21.440893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:21.440893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:21.440893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:21.487794 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:21.488603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:21.497063 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:21.497557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:21.498418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:21.498847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:21.545725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:21.555095 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-84f1fd2e-6b70-4f05-ab75-0feaf86aa33c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.166738 Sep 15 09:01:21.566872 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 347/726] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:21 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:21.763974 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:21.772680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-304abee9-5ffc-4aa0-946b-25a920e74737 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.296740 Sep 15 09:01:21.773404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 380/727] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:21 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:22.231813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:22.232519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:22.246968 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:22.247424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:22.248220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:22.248647 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:22.464317 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:22.486805 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:22.494492 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:22.495581 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5c5b5146-6fce-44f1-950b-12195c56146e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.275043 Sep 15 09:01:22.496104 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 348/728] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:22 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:22.579725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:22.580420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:22.588013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:22.588535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:22.589413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:22.589913 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:22.712741 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:22.721228 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-271f5e88-7c8f-4c4f-a60e-326ff17750a0 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.151182 Sep 15 09:01:22.721759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 381/729] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:22 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:22.800817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:22.802294 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:22.812393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:22.812838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:22.813617 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:22.814040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:23.036461 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:23.046570 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e30e14da-603b-42f0-8f6a-43f1daab4324 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.260604 Sep 15 09:01:23.047244 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 349/730] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:22 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:23.520702 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:23.521207 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:23.528726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:23.529167 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:23.529938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:23.530389 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:23.744542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:23.745169 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:23.752674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:23.753393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:23.754390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:23.755019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:23.756325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:23.771799 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:23.778297 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:23.779427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8a68dddf-dba5-4052-b1d6-191b10727c04 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.268242 Sep 15 09:01:23.779928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 382/731] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:23 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:23.886666 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:23.896145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-eb13a6e4-3402-4275-a092-9c53c5a8241d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1470 microversion: 2.1 time: 0.161562 Sep 15 09:01:23.896864 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 350/732] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:23 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:24.069396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:24.070002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:24.077092 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:24.077544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:24.078330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:24.078763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:24.299114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:24.308028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6e299b33-b100-4bca-9c69-f8396e783400 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.247922 Sep 15 09:01:24.308548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 383/733] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:24 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:24.419955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1012608911", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "networks": [{"uuid": "3b211f18-bead-4cfb-916e-940c2837e9c6"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:24.488495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] validate_networks() for [('3b211f18-bead-4cfb-916e-940c2837e9c6', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:01:24.803408 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:24.803975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:24.811891 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:24.812343 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:24.813156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:24.813584 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.045987 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:25.061033 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:25.067255 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:25.068863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8cec2823-4eab-4d00-b9be-f5ce7023b356 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.275185 Sep 15 09:01:25.069379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 384/734] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:24 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:01:25.079449 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:25.080246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:25.088114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:25.088551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.089340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:25.089931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.169104 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:25.169803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.170496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lazy-loading 'fault' on Instance uuid 588ad70f-a4ba-41bd-98fc-3b3d3fd24904 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:25.235941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:25.246423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6eb5cba1-dd5d-48ff-a962-64f50e7496c2 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 200 len: 1307 microversion: 2.1 time: 0.175176 Sep 15 09:01:25.246532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 385/735] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:25 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:25.333062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:25.333565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:25.341805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:25.341805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.342568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:25.342998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.531021 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:01:25.531523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:01:25.531929 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:01:25.532332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:01:25.532740 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:01:25.541353 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:25.541802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.542706 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:25.543072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:25.563068 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:25.564049 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Getting quotas for project 3bf945ad7abb4cedb3e57185c376c289. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:01:25.568175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Getting quotas for user 2d0dc9c4c21c4569860e648e725a6d90 and project 3bf945ad7abb4cedb3e57185c376c289. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:01:25.573733 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-941f350d-4df9-4002-91b1-cfb4c04c1db9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.252341 Sep 15 09:01:25.574768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 386/736] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:25 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:25.583363 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:01:25.586016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:01:25.742571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fe540ee8-a184-4fb8-8232-03075ab0bafc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331521 Sep 15 09:01:25.743191 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 351/737] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:01:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 09:01:25.767971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b125c710-648f-4a0e-9df1-41612dc8c6a7 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:25.768227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b125c710-648f-4a0e-9df1-41612dc8c6a7 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:25.771673 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:01:25.771812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:01:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 (ip 10.222.0.39) !!! Sep 15 09:01:25.868507 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b125c710-648f-4a0e-9df1-41612dc8c6a7 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:25.877439 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b125c710-648f-4a0e-9df1-41612dc8c6a7 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1219 microversion: 2.1 time: 0.126045 Sep 15 09:01:25.886996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 387/738] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:25 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:26.095198 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:26.096233 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:26.106203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.106795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:26.107762 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.108570 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:26.274809 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:26.275491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 588ad70f-a4ba-41bd-98fc-3b3d3fd24904] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:26.282746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.283185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:26.285667 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.285667 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:26.333094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:26.334942 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] HTTP exception thrown: Instance 588ad70f-a4ba-41bd-98fc-3b3d3fd24904 could not be found. Sep 15 09:01:26.335532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Returning 404 to user: Instance 588ad70f-a4ba-41bd-98fc-3b3d3fd24904 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:01:26.336419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-972be4bb-cfa9-4887-be1a-5d91b9b815e9 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904" status: 404 len: 111 microversion: 2.1 time: 0.071423 Sep 15 09:01:26.337259 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 388/739] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:26 2021] GET /compute/v2.1/servers/588ad70f-a4ba-41bd-98fc-3b3d3fd24904 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 09:01:26.351620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:26.357869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:26.359103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-44de64dc-4693-429b-b9fb-23fb63bbd03b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.276085 Sep 15 09:01:26.359516 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 352/740] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:26 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:26.600636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:26.600636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:26.606940 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.607734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:26.608486 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.608914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:26.887194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:26.897708 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1373d51b-d8b3-42dd-8b2d-3dc0fa601020 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.310956 Sep 15 09:01:26.898935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 389/741] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:26 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:26.900090 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:26.900708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:26.908522 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.909217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:26.909988 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:26.910443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:27.041314 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:27.049101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4c36c5a4-3f51-4782-83ab-270f02d038cd tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1223 microversion: 2.1 time: 0.158246 Sep 15 09:01:27.049634 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 353/742] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:26 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1223 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:27.384553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:27.384553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:27.391098 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:27.391541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:27.392312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:27.392743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:27.597727 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:27.611998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:27.618399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:27.619518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0f1f2a1a-402e-45c3-8dd7-48826536b9b2 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.245683 Sep 15 09:01:27.620043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 390/743] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:27 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:27.920869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:27.921478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:27.928604 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:27.929055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:27.929905 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:27.930364 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:28.071663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:28.072257 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:28.079537 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:28.079914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:28.080684 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:28.081284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:28.144701 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:28.156885 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7196ba9b-3037-487a-b428-12ed25ef1086 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.245595 Sep 15 09:01:28.166608 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 354/744] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:27 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:28.213807 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:28.221879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-caf3d5cf-f6e3-42e5-b830-628750af83e9 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1215 microversion: 2.1 time: 0.159907 Sep 15 09:01:28.222611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 391/745] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:28 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:28.642550 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:28.643203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:28.650485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:28.650921 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:28.651677 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:28.652176 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:28.857849 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:28.872583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:28.878834 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:28.879921 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-227331c7-21f6-4320-9ff9-adebbf198e79 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.247138 Sep 15 09:01:28.880428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 355/746] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:28 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:29.177799 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:29.178429 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:29.185418 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:29.185848 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:29.186665 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:29.187069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:29.244936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:29.245617 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:29.253436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:29.253838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:29.254759 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:29.255246 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:29.385855 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:29.394305 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-173ec3b5-c5fa-4c77-b957-ff50e89bc451 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1215 microversion: 2.1 time: 0.159269 Sep 15 09:01:29.397638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 356/747] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:29 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:29.411287 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:29.420476 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-336e14f6-5e5a-4ae4-bd33-c72969d23f45 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.251659 Sep 15 09:01:29.420996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 392/748] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:29 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:29.903963 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:29.904569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:29.911902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:29.916431 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:29.916431 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:29.916431 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:30.122269 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:30.136952 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:30.143283 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:30.144383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-10c0fb0c-7c90-458c-80b1-26d93e871850 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.249809 Sep 15 09:01:30.144900 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 357/749] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:29 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:30.419196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:30.419763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:30.427097 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:30.427537 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:30.428291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:30.428746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:30.443502 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:30.444262 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:30.455126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:30.456319 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:30.457593 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:30.458130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:30.567048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:30.576740 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-390a3ea9-66f1-4d7d-91a2-c0fb934ecbb1 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1271 microversion: 2.1 time: 0.167079 Sep 15 09:01:30.577593 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 393/750] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:30 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:30.677830 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:30.687141 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-02348471-3466-46b4-82c0-a3d67c02f637 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1555 microversion: 2.1 time: 0.254212 Sep 15 09:01:30.687675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 358/751] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:30 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:31.004746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:31.005231 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:31.012724 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.013484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.014441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.015020 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.081241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:01:31.169369 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:31.169989 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:31.177764 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.178238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.179018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.180348 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.392752 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-085d5c07-e4e4-4a8c-98df-d08ba0b9a86b tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "DELETE /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 204 len: 0 microversion: 2.1 time: 0.396817 Sep 15 09:01:31.393447 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 394/752] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:01:30 2021] DELETE /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:01:31.408510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:31.409305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:31.416671 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.417180 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.417964 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.418429 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.636567 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:31.639600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:31.652600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dd258163-2a7e-4f56-bc1c-9907ee20ed26 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1512 microversion: 2.1 time: 0.254195 Sep 15 09:01:31.656269 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:31.661659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 395/753] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:31 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:31.663224 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:31.664390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-92f63e4b-325f-4fbd-b78f-c65a8236498d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.505450 Sep 15 09:01:31.664938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 359/754] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:31 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:01:31.679904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:31.681988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:31.688698 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.689137 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.689906 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.690383 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.716228 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:31.716834 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:31.734915 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.735265 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.736662 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:31.737238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:31.955508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:31.963963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-62527daf-74a1-47c6-99ab-2d51db634337 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.300926 Sep 15 09:01:31.964735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 396/755] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:31 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:32.112923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:32.122194 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ace11024-90a8-4d8b-bdaf-e83854487707 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1561 microversion: 2.1 time: 0.422089 Sep 15 09:01:32.122714 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 360/756] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:31 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1561 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:32.243764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-efc0ee5f-237c-4a77-b1cb-cfdc9fbf9f8f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:32.244315 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-efc0ee5f-237c-4a77-b1cb-cfdc9fbf9f8f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:32.252679 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-efc0ee5f-237c-4a77-b1cb-cfdc9fbf9f8f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.252679 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-efc0ee5f-237c-4a77-b1cb-cfdc9fbf9f8f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:32.253547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-efc0ee5f-237c-4a77-b1cb-cfdc9fbf9f8f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.253832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-efc0ee5f-237c-4a77-b1cb-cfdc9fbf9f8f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:32.665288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-efc0ee5f-237c-4a77-b1cb-cfdc9fbf9f8f tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "DELETE /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments/bcfcbc6e-ef7a-4445-81c9-2532c04a33d6" status: 202 len: 0 microversion: 2.1 time: 0.431083 Sep 15 09:01:32.666216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 397/757] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:01:32 2021] DELETE /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments/bcfcbc6e-ef7a-4445-81c9-2532c04a33d6 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:01:32.674193 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:32.674798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:32.681988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a83e135c-f66b-42e6-a43c-ba915ddb3c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:32.683405 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a83e135c-f66b-42e6-a43c-ba915ddb3c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:32.683995 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.684436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:32.685224 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.685638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:32.692041 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a83e135c-f66b-42e6-a43c-ba915ddb3c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.692730 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a83e135c-f66b-42e6-a43c-ba915ddb3c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:32.693635 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a83e135c-f66b-42e6-a43c-ba915ddb3c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.694162 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a83e135c-f66b-42e6-a43c-ba915ddb3c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:32.769234 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a83e135c-f66b-42e6-a43c-ba915ddb3c67 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098877 Sep 15 09:01:32.769789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 398/758] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:01:32 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:01:32.782252 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:32.782252 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:32.788318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.788759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:32.789564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:32.790147 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:33.160817 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:33.191564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:33.201278 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:33.203025 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bfb14c51-05fb-419d-82c1-50883b193783 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.432250 Sep 15 09:01:33.204143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 399/759] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:32 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:33.216920 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:33.220855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:33.228385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:33.229191 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:33.230464 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:33.231867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:33.396227 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:33.416791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-69e964c2-fff6-4ffe-9b9b-3411223e3be5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1512 microversion: 2.1 time: 0.751692 Sep 15 09:01:33.417528 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 361/760] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:32 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1512 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:33.456010 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:33.464564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5852c418-11db-4317-b495-1930eb7bbebc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.258821 Sep 15 09:01:33.465101 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 400/761] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:33 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:33.746483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-7021b10a-5d30-42a3-b9c2-6a3c3ec7aaf1 req-d9e7df82-fb16-489c-b88e-121317fd17dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86cee43-cf9a-4232-8596-966bef68ed90", "tag": "0ac5ee06-75f4-4b1d-a751-c0b49bcf449e"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:33.757495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:33.757495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:01:33.766543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-7021b10a-5d30-42a3-b9c2-6a3c3ec7aaf1 req-d9e7df82-fb16-489c-b88e-121317fd17dc service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:33.766981 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-7021b10a-5d30-42a3-b9c2-6a3c3ec7aaf1 req-d9e7df82-fb16-489c-b88e-121317fd17dc service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:33.799525 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c2e9e2c5-83b5-47dd-9e6a-9a70ea39f39b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:33.802218 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c2e9e2c5-83b5-47dd-9e6a-9a70ea39f39b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:33.815552 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2e9e2c5-83b5-47dd-9e6a-9a70ea39f39b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:33.816002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2e9e2c5-83b5-47dd-9e6a-9a70ea39f39b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:33.820685 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-7021b10a-5d30-42a3-b9c2-6a3c3ec7aaf1 req-d9e7df82-fb16-489c-b88e-121317fd17dc service nova] Creating event network-changed:0ac5ee06-75f4-4b1d-a751-c0b49bcf449e for instance c86cee43-cf9a-4232-8596-966bef68ed90 on hv-cinder-80600 Sep 15 09:01:33.821906 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2e9e2c5-83b5-47dd-9e6a-9a70ea39f39b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:33.822387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c2e9e2c5-83b5-47dd-9e6a-9a70ea39f39b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:33.827315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-7021b10a-5d30-42a3-b9c2-6a3c3ec7aaf1 req-d9e7df82-fb16-489c-b88e-121317fd17dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090378 Sep 15 09:01:33.827315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 362/762] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:01:33.909532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c2e9e2c5-83b5-47dd-9e6a-9a70ea39f39b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131433 Sep 15 09:01:33.910305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 401/763] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:01:33 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:34.227915 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:34.228607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:34.236424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:34.237105 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:34.237874 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:34.238350 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:34.443358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:34.445285 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:34.463983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:34.464629 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:34.467267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:34.473827 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:34.727898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:34.736373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-89536aab-1808-4659-9c9b-eed16fab9e77 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1512 microversion: 2.1 time: 0.307239 Sep 15 09:01:34.737013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 402/764] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:34 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:34.747989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:34.748626 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:34.756015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:34.756462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:34.757232 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:34.758306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.037710 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:35.046832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-adbd0951-9342-4d7b-a3d8-7243e2d73637 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.308622 Sep 15 09:01:35.047483 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 403/765] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:34 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:35.058256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-fa7cfacc-70b7-4770-af5c-4673671a8180 req-046e9a12-169b-43a6-be24-8dab353a2a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba14ca7-eb88-437e-9c49-5101925f639b", "name": "network-vif-plugged", "status": "completed", "tag": "314b817f-9c79-46cf-a672-a625eea4af10"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:35.065120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:35.065120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:01:35.074246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-fa7cfacc-70b7-4770-af5c-4673671a8180 req-046e9a12-169b-43a6-be24-8dab353a2a28 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:35.074876 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-fa7cfacc-70b7-4770-af5c-4673671a8180 req-046e9a12-169b-43a6-be24-8dab353a2a28 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.083159 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:35.093659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-fa7cfacc-70b7-4770-af5c-4673671a8180 req-046e9a12-169b-43a6-be24-8dab353a2a28 service nova] Creating event network-vif-plugged:314b817f-9c79-46cf-a672-a625eea4af10 for instance 5ba14ca7-eb88-437e-9c49-5101925f639b on hv-cinder-80600 Sep 15 09:01:35.100616 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-fa7cfacc-70b7-4770-af5c-4673671a8180 req-046e9a12-169b-43a6-be24-8dab353a2a28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051660 Sep 15 09:01:35.101201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 404/766] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:35.122169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7379e5b4-e881-4018-9b86-31572e46cda3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:35.123357 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7379e5b4-e881-4018-9b86-31572e46cda3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:35.128556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:35.145867 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:35.147823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7545a377-a780-4b29-855d-96c37608ed2b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.930279 Sep 15 09:01:35.148545 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7379e5b4-e881-4018-9b86-31572e46cda3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:35.153759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7379e5b4-e881-4018-9b86-31572e46cda3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.154610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7379e5b4-e881-4018-9b86-31572e46cda3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:35.155162 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7379e5b4-e881-4018-9b86-31572e46cda3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.168958 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 363/767] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:34 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:35.272696 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7379e5b4-e881-4018-9b86-31572e46cda3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170184 Sep 15 09:01:35.273837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 405/768] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:01:35 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:01:35.768023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:35.771098 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:35.793843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:35.794336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.795108 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:35.795542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.872309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:35.872751 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.873192 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lazy-loading 'fault' on Instance uuid 50af7e90-3b57-4e95-97b0-e298f753c007 {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:35.882364 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-dd526d60-603e-4615-9a68-51147bab242a req-f6a01df5-dba9-4b05-8192-f6121adb690d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50af7e90-3b57-4e95-97b0-e298f753c007", "name": "network-vif-deleted", "tag": "940aa7fc-de3e-46ed-ae69-062a759e8fdc"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:35.890015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:35.890015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:01:35.899666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-dd526d60-603e-4615-9a68-51147bab242a req-f6a01df5-dba9-4b05-8192-f6121adb690d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:35.900186 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-dd526d60-603e-4615-9a68-51147bab242a req-f6a01df5-dba9-4b05-8192-f6121adb690d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:35.917746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-dd526d60-603e-4615-9a68-51147bab242a req-f6a01df5-dba9-4b05-8192-f6121adb690d service nova] Creating event network-vif-deleted:940aa7fc-de3e-46ed-ae69-062a759e8fdc for instance 50af7e90-3b57-4e95-97b0-e298f753c007 on hv-cinder-80600 Sep 15 09:01:35.922592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-dd526d60-603e-4615-9a68-51147bab242a req-f6a01df5-dba9-4b05-8192-f6121adb690d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051197 Sep 15 09:01:35.923923 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 406/769] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:36.070936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:36.071613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:36.079333 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:36.079744 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:36.080524 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:36.080960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:36.190656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:36.200239 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-15136d80-bea1-4173-858c-00071e6cf4e6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 200 len: 1307 microversion: 2.1 time: 0.450129 Sep 15 09:01:36.201016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 364/770] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:35 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:36.214512 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:36.215383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:36.222881 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:36.223331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:36.224132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:36.224781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:36.339424 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:36.351033 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-778f76ff-7e5f-4db9-9646-2170ac7795d6 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.290405 Sep 15 09:01:36.352336 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 407/771] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:36 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:36.492711 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:36.506714 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:36.513552 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:36.514704 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a1508bd0-587c-424e-ada2-254376d1cc16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.312536 Sep 15 09:01:36.518821 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 365/772] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:36 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:37.222585 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:37.223183 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 50af7e90-3b57-4e95-97b0-e298f753c007] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:37.230866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.231304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.232062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.232486 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.281130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] HTTP exception thrown: Instance 50af7e90-3b57-4e95-97b0-e298f753c007 could not be found. Sep 15 09:01:37.281701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Returning 404 to user: Instance 50af7e90-3b57-4e95-97b0-e298f753c007 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:01:37.282528 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f0a9943d-9c9d-47ac-bed1-f3db401cfbd5 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007" status: 404 len: 111 microversion: 2.1 time: 0.069064 Sep 15 09:01:37.283043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 408/773] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:37 2021] GET /compute/v2.1/servers/50af7e90-3b57-4e95-97b0-e298f753c007 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:01:37.296980 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:37.297481 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:37.304682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.305126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.305883 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.306603 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.371395 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:01:37.373675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:37.374288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:37.381410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.381782 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.382592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.383021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.615806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:37.642687 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7f72b3d8-63f4-44cd-b9c8-0edf880ad95d tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.278506 Sep 15 09:01:37.643586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 409/774] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:37 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:37.654353 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:37.658363 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:37.662216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.662659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.663738 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.664675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.735729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-13fa1205-9de2-4a67-bb38-cbb742cad0f6 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 204 len: 0 microversion: 2.1 time: 0.448106 Sep 15 09:01:37.736648 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 366/775] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:01:37 2021] DELETE /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:01:37.761814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:37.761814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:37.766902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.767406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.768475 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:37.769016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:37.916279 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:37.930434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:37.936903 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:37.941154 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-69f5abfb-6fca-4646-93bd-5ed3b7f60e09 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.293537 Sep 15 09:01:37.941154 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 410/776] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:37 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:38.004180 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:38.012764 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-52cae781-40ac-4db8-b893-b668a9f62834 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1514 microversion: 2.1 time: 0.270827 Sep 15 09:01:38.013280 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 367/777] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:37 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:38.284957 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:38.285473 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:38.293594 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:38.294048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:38.294865 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:38.295303 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:38.374298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:01:38.665832 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:38.666459 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:38.673545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:38.673984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:38.674805 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:38.675319 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:38.745393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-265db876-80a9-4245-a980-bf34794d2936 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 204 len: 0 microversion: 2.1 time: 0.469358 Sep 15 09:01:38.746208 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 411/778] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:01:38 2021] DELETE /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:01:38.760220 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:38.760911 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:38.768190 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:38.768636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:38.769407 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:38.769840 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:38.980152 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:38.982956 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:38.988994 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d7a0c660-3d0b-4121-93b8-512e6c848f2b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.332689 Sep 15 09:01:38.989671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 368/779] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:38 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:38.991495 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c6a89f06-a3fc-46de-b710-b606ee6f6bf2 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1508 microversion: 2.1 time: 0.240850 Sep 15 09:01:38.992934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 412/780] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:38 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:39.001342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:39.001946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:39.009584 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:39.010024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:39.010828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:39.011295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:39.034785 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:39.035515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:39.044422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:39.044991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:39.045860 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:39.046419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:39.229527 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:39.244509 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:39.250867 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:39.253034 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c6897c3d-4d86-4dc2-b7e0-a695beeeab34 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1808 microversion: 2.20 time: 0.261227 Sep 15 09:01:39.254051 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:39.254537 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 369/781] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:38 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:39.264222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-79c185e1-72c1-4744-8a66-9a4b96b74365 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1514 microversion: 2.1 time: 0.238837 Sep 15 09:01:39.274147 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 413/782] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:39 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:40.014828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:40.015387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:40.019453 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:40.020153 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:40.023138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.023575 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.025273 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.025273 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.027655 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.028174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.029026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.029523 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.245520 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:40.253698 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a5b23c93-9602-4711-9de7-6b551c73c01b tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.243447 Sep 15 09:01:40.254257 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 414/783] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:40 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:40.276983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:40.277500 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:40.284702 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.285138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.285891 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.286347 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.501824 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:40.518606 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:40.526969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:40.528174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3f5200b2-541f-4b3e-82cf-2a2a4ad52118 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1795 microversion: 2.20 time: 0.260637 Sep 15 09:01:40.528644 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 415/784] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:01:40 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1795 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:01:40.533971 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:40.539505 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:40.540315 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:40.545369 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5c67d797-f91a-4b17-9297-d15d4e7ef60e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1508 microversion: 2.1 time: 0.540520 Sep 15 09:01:40.549054 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 370/785] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:40 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:40.550902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.551421 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.552295 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.552808 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.693724 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:40.704713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4e0bf1f5-071b-4e96-bcdb-c35251389040 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1472 microversion: 2.1 time: 0.174909 Sep 15 09:01:40.709566 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 416/786] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:40 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:40.807908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-7cb263a4-ceb6-4e21-aa07-d5feabd66730 req-49950c39-42f6-48c1-9c92-d0360dd7603b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefb9f8f-d4a0-4329-b49e-f884bcf35681", "name": "network-vif-deleted", "tag": "7cd7187b-41bd-477b-985e-41fe4e886e86"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:40.815830 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:40.815830 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:01:40.825329 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-7cb263a4-ceb6-4e21-aa07-d5feabd66730 req-49950c39-42f6-48c1-9c92-d0360dd7603b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.826033 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-7cb263a4-ceb6-4e21-aa07-d5feabd66730 req-49950c39-42f6-48c1-9c92-d0360dd7603b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.845639 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-7cb263a4-ceb6-4e21-aa07-d5feabd66730 req-49950c39-42f6-48c1-9c92-d0360dd7603b service nova] Creating event network-vif-deleted:7cd7187b-41bd-477b-985e-41fe4e886e86 for instance fefb9f8f-d4a0-4329-b49e-f884bcf35681 on hv-cinder-80600 Sep 15 09:01:40.852419 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-7cb263a4-ceb6-4e21-aa07-d5feabd66730 req-49950c39-42f6-48c1-9c92-d0360dd7603b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054559 Sep 15 09:01:40.852419 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 371/787] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:01:40.877388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-19133b3a-1524-4537-b050-0c34f20a259f req-fbd8c4d2-aa75-4bf7-b970-5a80d5b3233a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86cee43-cf9a-4232-8596-966bef68ed90", "name": "network-vif-plugged", "status": "completed", "tag": "0ac5ee06-75f4-4b1d-a751-c0b49bcf449e"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:40.884065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:40.884065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:01:40.895006 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-19133b3a-1524-4537-b050-0c34f20a259f req-fbd8c4d2-aa75-4bf7-b970-5a80d5b3233a service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:40.895440 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-19133b3a-1524-4537-b050-0c34f20a259f req-fbd8c4d2-aa75-4bf7-b970-5a80d5b3233a service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:40.912547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-19133b3a-1524-4537-b050-0c34f20a259f req-fbd8c4d2-aa75-4bf7-b970-5a80d5b3233a service nova] Creating event network-vif-plugged:0ac5ee06-75f4-4b1d-a751-c0b49bcf449e for instance c86cee43-cf9a-4232-8596-966bef68ed90 on hv-cinder-80600 Sep 15 09:01:40.917771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-19133b3a-1524-4537-b050-0c34f20a259f req-fbd8c4d2-aa75-4bf7-b970-5a80d5b3233a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049629 Sep 15 09:01:40.918561 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 417/788] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:41.277934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:41.278641 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:41.286893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:41.287338 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:41.288131 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:41.289157 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:41.546808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:41.555513 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-97ad2c79-8677-473d-841d-ad0b891c1034 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.289212 Sep 15 09:01:41.556211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 372/789] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:41 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:41.571699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:41.572736 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:41.581368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:41.581819 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:41.582887 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:41.583332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:41.729752 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:41.730419 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:41.742560 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:41.744275 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:41.744275 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:41.744697 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:41.824582 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:41.832178 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:41.832547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:41.832752 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-979b7785-7636-4b7a-9bb3-fc263e54cb5a tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1508 microversion: 2.1 time: 0.271867 Sep 15 09:01:41.833002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lazy-loading 'fault' on Instance uuid fefb9f8f-d4a0-4329-b49e-f884bcf35681 {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:41.833340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 418/790] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:41 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:41.964592 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:41.972648 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a2134fb4-83a4-4275-b4dc-8cd4bc1fea6c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 200 len: 1308 microversion: 2.1 time: 0.252443 Sep 15 09:01:41.973170 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 373/791] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:41 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:42.578026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:42.578722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:42.586242 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:42.589768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:42.589768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:42.589768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:42.793128 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:42.802626 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5f45d22b-0d68-4106-b055-8ac942fcadde tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1319 microversion: 2.1 time: 0.232866 Sep 15 09:01:42.802626 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 419/792] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:42 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:42.857871 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:42.858521 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:42.865818 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:42.866318 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:42.867371 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:42.867983 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:42.995241 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:42.995841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: fefb9f8f-d4a0-4329-b49e-f884bcf35681] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:43.003201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:43.003695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:43.004468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:43.004934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:43.055180 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] HTTP exception thrown: Instance fefb9f8f-d4a0-4329-b49e-f884bcf35681 could not be found. Sep 15 09:01:43.055777 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Returning 404 to user: Instance fefb9f8f-d4a0-4329-b49e-f884bcf35681 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:01:43.056599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6ecd61fe-e283-4cdd-9b0b-5de31d19db27 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681" status: 404 len: 111 microversion: 2.1 time: 0.070985 Sep 15 09:01:43.057151 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 420/793] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:42 2021] GET /compute/v2.1/servers/fefb9f8f-d4a0-4329-b49e-f884bcf35681 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 09:01:43.310134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:43.318831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6af40be5-38b2-4790-a818-420aaf594897 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1508 microversion: 2.1 time: 0.472358 Sep 15 09:01:43.329615 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 374/794] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:42 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:43.825403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:43.826072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:43.833249 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:43.833749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:43.834626 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:43.835151 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:43.970398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-4ddf9851-a86d-455d-8f4e-bb43226b18b7 req-a16b9e13-0954-452c-9ada-b2138eb5db13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc1c15f-24f5-496f-a675-9771d0025292", "name": "network-vif-deleted", "tag": "834d7008-fc0a-404f-8253-016e3f7d8ca2"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:43.981547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:43.981547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:01:43.990508 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-4ddf9851-a86d-455d-8f4e-bb43226b18b7 req-a16b9e13-0954-452c-9ada-b2138eb5db13 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:43.994435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-4ddf9851-a86d-455d-8f4e-bb43226b18b7 req-a16b9e13-0954-452c-9ada-b2138eb5db13 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.011729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-4ddf9851-a86d-455d-8f4e-bb43226b18b7 req-a16b9e13-0954-452c-9ada-b2138eb5db13 service nova] Creating event network-vif-deleted:834d7008-fc0a-404f-8253-016e3f7d8ca2 for instance 9bc1c15f-24f5-496f-a675-9771d0025292 on hv-cinder-80600 Sep 15 09:01:44.017234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-4ddf9851-a86d-455d-8f4e-bb43226b18b7 req-a16b9e13-0954-452c-9ada-b2138eb5db13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057179 Sep 15 09:01:44.018492 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 375/795] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:01:44.092869 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:44.101658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e1ae18bb-f7eb-48da-84f5-fbc044cba3b3 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1508 microversion: 2.1 time: 0.285804 Sep 15 09:01:44.102258 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 421/796] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:43 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:44.124539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-077df508-5cad-44b1-9f7e-5ece08bebd19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fbd856f-b35a-4bd2-8549-44f1e939926b", "device": "/dev/sdb"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:44.125716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-077df508-5cad-44b1-9f7e-5ece08bebd19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:44.133423 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-077df508-5cad-44b1-9f7e-5ece08bebd19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.133871 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-077df508-5cad-44b1-9f7e-5ece08bebd19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.134675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-077df508-5cad-44b1-9f7e-5ece08bebd19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.135100 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-077df508-5cad-44b1-9f7e-5ece08bebd19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.342386 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:44.342906 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:44.350115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.350562 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.351957 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.352384 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.430329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.430773 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.431221 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'fault' on Instance uuid 9bc1c15f-24f5-496f-a675-9771d0025292 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:44.497408 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:44.505664 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fe10d830-f79b-4711-8149-638c3a7f5a52 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 200 len: 1312 microversion: 2.1 time: 0.173391 Sep 15 09:01:44.506211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 422/797] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:44 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:44.516691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:44.517177 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:44.524331 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.524773 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.525533 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.526042 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.594311 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:01:44.952992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-952ac436-503d-46bb-a358-195b7e73bc1a tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 204 len: 0 microversion: 2.1 time: 0.445511 Sep 15 09:01:44.953815 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 423/798] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:01:44 2021] DELETE /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:01:44.968308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:44.969003 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:44.976823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.977261 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.978029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:44.978553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:44.984950 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-077df508-5cad-44b1-9f7e-5ece08bebd19 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "POST /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870712 Sep 15 09:01:44.985525 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 376/799] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:01:44 2021] POST /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:45.227456 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:45.235847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-da95b06b-a921-421e-9a27-c6c924202bdc tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1512 microversion: 2.1 time: 0.277443 Sep 15 09:01:45.238126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 424/800] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:44 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:45.529990 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:45.530715 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 9bc1c15f-24f5-496f-a675-9771d0025292] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:45.538899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:45.539339 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:45.540124 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:45.540551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:45.589834 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] HTTP exception thrown: Instance 9bc1c15f-24f5-496f-a675-9771d0025292 could not be found. Sep 15 09:01:45.590454 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Returning 404 to user: Instance 9bc1c15f-24f5-496f-a675-9771d0025292 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:01:45.591279 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-778f1e5a-e0d6-4f36-977b-ec49a0d12141 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292" status: 404 len: 111 microversion: 2.1 time: 0.072096 Sep 15 09:01:45.591823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 377/801] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:45 2021] GET /compute/v2.1/servers/9bc1c15f-24f5-496f-a675-9771d0025292 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:01:45.605191 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:45.607683 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:45.612896 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:45.613339 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:45.614122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:45.614557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:45.680046 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:01:46.020946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-12fa1486-6d39-4bd3-aaef-62fb61f7663b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "DELETE /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 204 len: 0 microversion: 2.1 time: 0.424549 Sep 15 09:01:46.021568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 425/802] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:01:45 2021] DELETE /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:01:46.035314 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:46.035969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:46.043370 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:46.043884 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:46.044643 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:46.045065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:46.258750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:46.259436 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:46.266769 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:46.267212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:46.267975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:46.268405 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:46.363516 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:46.372384 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ccb300e9-864c-4db1-8e62-b852bcb7ace0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.346651 Sep 15 09:01:46.372914 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 378/803] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:46 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:46.478757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:46.487076 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c6364c8d-079d-4c9f-a2a4-23dbe96bd93c tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1512 microversion: 2.1 time: 0.237923 Sep 15 09:01:46.487571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 426/804] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:46 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:47.394408 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:47.395092 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:47.402284 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:47.402807 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:47.403649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:47.404172 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:47.511599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:47.512143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:47.519924 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:47.520464 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:47.521522 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:47.521856 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:47.729879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:47.738002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-913390ba-1b93-4372-b4f0-8c4065b9f63d tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1512 microversion: 2.1 time: 0.237411 Sep 15 09:01:47.738599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 427/805] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:47 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:47.794364 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:47.802533 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-50eb7b30-3487-48ba-9a12-41a03e16262e tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.417204 Sep 15 09:01:47.803065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 379/806] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:47 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:48.555478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-90d27f52-7b0d-4f2a-ab99-f6fa4341fa3c req-1749c819-d255-44d5-8211-654f61242cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f", "name": "network-vif-deleted", "tag": "763240a6-6f8f-4069-b175-a718036b4722"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:48.562209 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:48.562209 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:01:48.571279 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-90d27f52-7b0d-4f2a-ab99-f6fa4341fa3c req-1749c819-d255-44d5-8211-654f61242cba service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:48.571717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-90d27f52-7b0d-4f2a-ab99-f6fa4341fa3c req-1749c819-d255-44d5-8211-654f61242cba service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:48.588960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-90d27f52-7b0d-4f2a-ab99-f6fa4341fa3c req-1749c819-d255-44d5-8211-654f61242cba service nova] Creating event network-vif-deleted:763240a6-6f8f-4069-b175-a718036b4722 for instance 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f on hv-cinder-80600 Sep 15 09:01:48.593675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-90d27f52-7b0d-4f2a-ab99-f6fa4341fa3c req-1749c819-d255-44d5-8211-654f61242cba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048035 Sep 15 09:01:48.594631 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 428/807] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:48.761100 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:48.761694 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:48.769080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:48.769518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:48.770313 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:48.770742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:48.826804 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:48.827651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:48.835140 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:48.835586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:48.836377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:48.836791 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:48.971700 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9a7f77c7354c099697032b66c9a99a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1349b239f2142be8df3073348f83d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:48.980540 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c1de3504-4be9-47a6-9518-1aa4f1527c24 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 200 len: 1302 microversion: 2.1 time: 0.229223 Sep 15 09:01:48.981401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 380/808] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:48 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 1302 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:49.050267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:49.059145 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fd876806-849f-4fa6-8a96-2a8c29d7ae32 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.243181 Sep 15 09:01:49.059726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 429/809] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:48 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:49.442651 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cac6017c-f528-4eb1-976e-19dbd0b7beca tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:49.443137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-cac6017c-f528-4eb1-976e-19dbd0b7beca tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:49.450427 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cac6017c-f528-4eb1-976e-19dbd0b7beca tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:49.451094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cac6017c-f528-4eb1-976e-19dbd0b7beca tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:49.451864 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cac6017c-f528-4eb1-976e-19dbd0b7beca tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:49.452292 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cac6017c-f528-4eb1-976e-19dbd0b7beca tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:49.863098 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cac6017c-f528-4eb1-976e-19dbd0b7beca tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-volume_attachments/647067bc-33ec-468d-8eda-c76e29794b25" status: 202 len: 0 microversion: 2.1 time: 0.429329 Sep 15 09:01:49.864537 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 381/810] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:01:49 2021] DELETE /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-volume_attachments/647067bc-33ec-468d-8eda-c76e29794b25 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:01:50.003811 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:50.004411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] [instance: 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:50.012222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:50.012663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:50.013433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:50.013855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:50.065556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] HTTP exception thrown: Instance 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f could not be found. Sep 15 09:01:50.066171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] Returning 404 to user: Instance 5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:01:50.066991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b3533eb4-79fa-4bff-ba86-d628ef8f90a8 tempest-AttachVolumeNegativeTest-1118426148 tempest-AttachVolumeNegativeTest-1118426148-project] 10.222.0.39 "GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f" status: 404 len: 111 microversion: 2.1 time: 0.072645 Sep 15 09:01:50.067530 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 430/811] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:49 2021] GET /compute/v2.1/servers/5c8ad2e2-a1d5-4d00-a86f-32eb577c3f0f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:01:50.082019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:50.082728 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:50.099123 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:50.099748 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:50.101202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:50.102139 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:50.462276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:50.472866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-81f7b021-0350-4e3f-9c84-0b70f8eb6a14 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.399103 Sep 15 09:01:50.481609 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 382/812] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:50 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:51.494965 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:51.495570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:51.504766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:51.504766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:51.504766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:51.504766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:51.776121 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:51.786155 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cac25dfb-e5ae-42b5-a774-805c51806ffd tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.301303 Sep 15 09:01:51.786700 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 431/813] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:51 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:52.815086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:52.816241 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:52.824686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:52.825325 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:52.826563 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:52.827507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:53.046703 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:53.055299 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7b10320b-460b-4613-b2fe-c7b0e4c0399b tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1521 microversion: 2.1 time: 0.249272 Sep 15 09:01:53.064417 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 383/814] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:52 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:54.077717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:54.078425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:54.085624 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:54.086200 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:54.087161 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:54.087661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:54.259744 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:54.268713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-eef282cd-ea4c-496b-9f8b-1075e23fcfe0 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1479 microversion: 2.1 time: 0.201110 Sep 15 09:01:54.279209 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 432/815] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:54 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1479 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:54.298718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-e8aa5d57-4eed-41ff-8f04-732815d09f33 req-f8a819ce-0b3e-4d4f-938b-3af4bb26cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d8f72b-fc30-41ab-922d-6e83c2b253e1", "name": "network-vif-deleted", "tag": "fd7b9192-1dcd-4cd1-8019-0543a7285ecc"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:54.305620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:01:54.305620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:01:54.316400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-e8aa5d57-4eed-41ff-8f04-732815d09f33 req-f8a819ce-0b3e-4d4f-938b-3af4bb26cba2 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:54.316967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-e8aa5d57-4eed-41ff-8f04-732815d09f33 req-f8a819ce-0b3e-4d4f-938b-3af4bb26cba2 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:54.334168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-e8aa5d57-4eed-41ff-8f04-732815d09f33 req-f8a819ce-0b3e-4d4f-938b-3af4bb26cba2 service nova] Creating event network-vif-deleted:fd7b9192-1dcd-4cd1-8019-0543a7285ecc for instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 on hv-cinder-80600 Sep 15 09:01:54.338938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-e8aa5d57-4eed-41ff-8f04-732815d09f33 req-f8a819ce-0b3e-4d4f-938b-3af4bb26cba2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050574 Sep 15 09:01:54.339529 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 384/816] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:01:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:01:54.576459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-47efb706-3e49-46be-84b9-519c2cfd19aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:01:54.584885 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-47efb706-3e49-46be-84b9-519c2cfd19aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:54.585313 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-47efb706-3e49-46be-84b9-519c2cfd19aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:54.650175 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-47efb706-3e49-46be-84b9-519c2cfd19aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Going to try to stop instance {{(pid=89582) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Sep 15 09:01:55.042651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-47efb706-3e49-46be-84b9-519c2cfd19aa tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 202 len: 0 microversion: 2.1 time: 0.477189 Sep 15 09:01:55.046838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 433/817] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:01:54 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:01:55.059496 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:55.060195 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:55.067549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:55.071264 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:55.071264 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:55.071264 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:55.291749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:55.292445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:55.299861 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:55.300312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:55.301225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:55.301653 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:55.329628 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:55.340681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-592bef85-c053-4773-99c7-236e0cd7e762 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.290027 Sep 15 09:01:55.340681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 385/818] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:55 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:55.376652 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:55.377104 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:55.377548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'fault' on Instance uuid 26d8f72b-fc30-41ab-922d-6e83c2b253e1 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:55.438190 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:55.446643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2c24c7a5-0973-4298-b661-33bd8a91570c tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1311 microversion: 2.1 time: 0.165138 Sep 15 09:01:55.447167 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 434/819] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:55 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:56.360289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:56.360888 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:56.368932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:56.369369 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:56.370151 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:56.370620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:56.468554 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:56.469148 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:56.476279 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:56.476754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:56.477515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:56.477941 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:56.559768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:56.560219 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:56.560678 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'fault' on Instance uuid 26d8f72b-fc30-41ab-922d-6e83c2b253e1 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:56.590827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:56.599072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3c636837-cd13-4b2e-aea3-1b1d3fa115f8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.247767 Sep 15 09:01:56.599672 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 386/820] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:56 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:56.636701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:56.644995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-783fca85-3e1f-4c31-b059-11daf9635645 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1311 microversion: 2.1 time: 0.185519 Sep 15 09:01:56.645724 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 435/821] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:56 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1311 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:57.622573 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:57.623255 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:57.630484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:57.630999 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:57.631854 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:57.632350 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:57.666260 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:57.666855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:57.673952 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:57.674431 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:57.675194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:57.675622 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:57.755452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:57.755942 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:57.756391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'fault' on Instance uuid 26d8f72b-fc30-41ab-922d-6e83c2b253e1 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:57.823467 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:57.835439 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c178e3d2-f4c0-4557-808e-5a3cf1152eb9 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1311 microversion: 2.1 time: 0.178565 Sep 15 09:01:57.836090 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 436/822] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:57 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:01:57.839303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:57.847739 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d3dbf30c-d84d-4125-a086-2a301ddc47fe tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.234770 Sep 15 09:01:57.848197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 387/823] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:57 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:58.856472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:58.857094 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:58.870495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:01:58.871245 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:01:58.879137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:58.879392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:58.879834 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:58.879957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:58.880614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:58.880861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:58.881043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:58.881463 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:58.972373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:01:58.973123 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:01:58.973559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lazy-loading 'fault' on Instance uuid 26d8f72b-fc30-41ab-922d-6e83c2b253e1 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:01:59.033457 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efcacffc3cbd4391a1cb4fdc52ba381c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd3fe44e1e5d42c0b4118a5b3004daac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:59.041748 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d0da0a97-f358-4785-ab22-b69d3ae924a3 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 200 len: 1311 microversion: 2.1 time: 0.194504 Sep 15 09:01:59.042290 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 437/824] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:58 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:01:59.088230 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:01:59.099689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e6e91766-8896-4621-ae0b-9aae918ade57 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.237852 Sep 15 09:01:59.100961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 388/825] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:01:58 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:00.063372 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:00.063963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] [instance: 26d8f72b-fc30-41ab-922d-6e83c2b253e1] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:00.071756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:00.072204 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:00.073003 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:00.073569 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:00.123474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] HTTP exception thrown: Instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 could not be found. Sep 15 09:02:00.124069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] Returning 404 to user: Instance 26d8f72b-fc30-41ab-922d-6e83c2b253e1 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:02:00.124883 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c40026aa-12db-43d1-ad12-7cc5d4c629c6 tempest-ServerRescueNegativeTestJSON-1056863947 tempest-ServerRescueNegativeTestJSON-1056863947-project] 10.222.0.39 "GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1" status: 404 len: 111 microversion: 2.1 time: 0.070774 Sep 15 09:02:00.125711 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 438/826] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:00 2021] GET /compute/v2.1/servers/26d8f72b-fc30-41ab-922d-6e83c2b253e1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:02:00.132236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:00.133128 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:00.141041 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:00.142472 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:00.143015 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:00.143607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:00.529542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:00.542485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-025ea5f5-69c7-4198-8b35-3c0ee4ce9301 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.423088 Sep 15 09:02:00.544653 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 389/827] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:00 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:01.567532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:01.568137 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:01.576450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:01.576892 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:01.577666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:01.578080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:01.830673 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:01.843312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8aba184d-5f9d-4b22-a288-7a5406e491d6 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.286180 Sep 15 09:02:01.851012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 439/828] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:01 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:02.879946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:02.880601 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:02.892317 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:02.892828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:02.893659 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:02.894261 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:03.196118 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:03.202844 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6145abb7-4ec9-4f1d-9430-853d9ea32915 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.345850 Sep 15 09:02:03.203880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 390/829] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:02 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:04.225857 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:04.226647 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:04.233866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:04.234800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:04.235794 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:04.236225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:04.548770 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:04.577081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b58e8be3-a0d1-40b5-bc10-e9fc49fb7ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.360908 Sep 15 09:02:04.579180 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 440/830] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:04 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:05.606512 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:05.607251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:05.615141 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:05.615749 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:05.617757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:05.625292 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:05.870432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:05.884776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cfa32592-7395-4a16-8f1d-ea1ddc70dc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.289052 Sep 15 09:02:05.886202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 391/831] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:05 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:06.911258 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:06.911858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:06.926477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:06.926477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:06.926477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:06.926477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:07.182716 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:07.190663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b3b425e1-a68a-460c-93cd-4608093c8e2a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.291631 Sep 15 09:02:07.191179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 441/832] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:06 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:02:08.215649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:08.216868 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:08.224026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:08.224201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-44683d07-08f9-46a7-9e36-17d0ce0a0601 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:08.230829 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-44683d07-08f9-46a7-9e36-17d0ce0a0601 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:08.230957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:08.230957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:08.230957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:08.232282 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44683d07-08f9-46a7-9e36-17d0ce0a0601 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:08.232723 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44683d07-08f9-46a7-9e36-17d0ce0a0601 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:08.233477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44683d07-08f9-46a7-9e36-17d0ce0a0601 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:08.233901 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44683d07-08f9-46a7-9e36-17d0ce0a0601 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:08.465367 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:08.474751 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-335d0f9b-446c-4a75-ab86-92e35368dcc4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.272018 Sep 15 09:02:08.485210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 392/833] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:08 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:08.743399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-44683d07-08f9-46a7-9e36-17d0ce0a0601 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90/os-volume_attachments/5fbd856f-b35a-4bd2-8549-44f1e939926b" status: 202 len: 0 microversion: 2.1 time: 0.528673 Sep 15 09:02:08.744024 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 442/834] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:02:08 2021] DELETE /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90/os-volume_attachments/5fbd856f-b35a-4bd2-8549-44f1e939926b => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 09:02:09.498527 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:09.499083 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:09.506646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:09.508760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:09.508760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:09.509392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:09.812080 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:09.820083 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a39acc7e-ac48-42a2-8eed-9312416945a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.331654 Sep 15 09:02:09.820599 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 393/835] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:09 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:10.842954 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:10.843652 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:10.852292 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:10.852930 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:10.854042 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:10.854647 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:11.091471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:11.100341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9c97694a-0a46-4867-896c-bbb8bf0aaf17 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.267214 Sep 15 09:02:11.110499 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 443/836] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:10 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:11.205008 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:11.205645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:11.215772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:11.216834 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:11.218332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:11.218944 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:11.293723 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:02:11.689875 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a2c4ae9e-2fb3-4f85-adfb-9b44ef57274e tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 204 len: 0 microversion: 2.1 time: 0.493727 Sep 15 09:02:11.690758 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 394/837] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:02:11 2021] DELETE /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:02:11.704559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:11.705174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:11.712661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:11.713111 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:11.713881 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:11.714334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:11.939536 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:11.947842 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-48ba6eb3-4e84-4e66-b44f-a7ff37d74433 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1514 microversion: 2.1 time: 0.252618 Sep 15 09:02:11.948448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 444/838] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:11 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:12.124593 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:12.125628 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:12.133289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:12.134048 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:12.135008 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:12.135502 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:12.434025 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:12.446590 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c8617f24-f801-4bba-b8ce-31ae2d4a8eee tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.331980 Sep 15 09:02:12.447289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 395/839] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:12 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:12.970944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:12.971661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:12.979084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:12.979525 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:12.980478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:12.980934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:13.211837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:13.220413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9abdab2c-6de2-4734-a85d-a5728edcf252 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1514 microversion: 2.1 time: 0.259162 Sep 15 09:02:13.221149 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 445/840] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:12 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:13.470295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:13.470890 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:13.478315 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:13.478759 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:13.479519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:13.480161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:13.698181 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:13.708187 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-09adac2e-f77d-45c7-b076-f82d6dc70355 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1678 microversion: 2.1 time: 0.247841 Sep 15 09:02:13.708898 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 396/841] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:13 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:14.245249 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:14.245872 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:14.258529 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:14.258970 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:14.259748 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:14.260175 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:14.478346 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:14.487081 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a78b6c45-44f7-415d-9601-e24a93dc5f90 tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1514 microversion: 2.1 time: 0.253824 Sep 15 09:02:14.487985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 446/842] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:14 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:14.657882 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-15b89beb-8a88-4815-8e6f-7c2d42238f61 req-d02fe765-80dc-4247-b593-37b3f9e97f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86cee43-cf9a-4232-8596-966bef68ed90", "name": "network-vif-deleted", "tag": "0ac5ee06-75f4-4b1d-a751-c0b49bcf449e"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:02:14.664827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:02:14.664827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:02:14.672952 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-15b89beb-8a88-4815-8e6f-7c2d42238f61 req-d02fe765-80dc-4247-b593-37b3f9e97f5d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:14.673380 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-15b89beb-8a88-4815-8e6f-7c2d42238f61 req-d02fe765-80dc-4247-b593-37b3f9e97f5d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:14.690262 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-15b89beb-8a88-4815-8e6f-7c2d42238f61 req-d02fe765-80dc-4247-b593-37b3f9e97f5d service nova] Creating event network-vif-deleted:0ac5ee06-75f4-4b1d-a751-c0b49bcf449e for instance c86cee43-cf9a-4232-8596-966bef68ed90 on hv-cinder-80600 Sep 15 09:02:14.695069 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-15b89beb-8a88-4815-8e6f-7c2d42238f61 req-d02fe765-80dc-4247-b593-37b3f9e97f5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046093 Sep 15 09:02:14.695669 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 397/843] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:02:14.732857 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:14.734908 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:14.748742 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:14.749194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:14.750029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:14.750526 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:14.970469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:14.978491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-046b261f-bd8f-4189-8289-a8c9d0da86ec tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1655 microversion: 2.1 time: 0.256967 Sep 15 09:02:14.979017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 447/844] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:14 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1655 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:15.001178 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-302b6fbb-1c75-43c2-9664-1ff1951504e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:02:15.009285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-302b6fbb-1c75-43c2-9664-1ff1951504e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:15.009730 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-302b6fbb-1c75-43c2-9664-1ff1951504e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:15.073739 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-302b6fbb-1c75-43c2-9664-1ff1951504e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Going to try to start instance {{(pid=89583) start /opt/stack/nova/nova/compute/api.py:2622}} Sep 15 09:02:15.285474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-302b6fbb-1c75-43c2-9664-1ff1951504e9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action" status: 202 len: 0 microversion: 2.1 time: 0.294333 Sep 15 09:02:15.286109 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 398/845] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:02:14 2021] POST /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:02:15.299307 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:15.299928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:15.307525 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:15.310283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:15.310283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:15.310283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:15.514026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:15.515212 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:15.524590 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:15.525111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:15.526407 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:15.526791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:15.581369 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:15.599734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c175f185-9865-4715-aa97-86839f3581d1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1664 microversion: 2.1 time: 0.309170 Sep 15 09:02:15.600425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 448/846] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:15 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1664 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:15.661377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:15.661919 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:15.662499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lazy-loading 'fault' on Instance uuid c86cee43-cf9a-4232-8596-966bef68ed90 {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:02:15.988411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0dc9c4c21c4569860e648e725a6d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf945ad7abb4cedb3e57185c376c289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:15.996687 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-24c18724-38a3-45de-bc92-020aecbc3fdc tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 200 len: 1309 microversion: 2.1 time: 0.495417 Sep 15 09:02:15.997224 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 399/847] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:15 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 1309 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:16.626465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:16.627041 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:16.634504 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:16.634956 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:16.635882 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:16.636169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:16.881004 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:16.894552 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ac8e6c6e-b214-4ff5-9bc4-f2497b2d9867 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1664 microversion: 2.1 time: 0.272866 Sep 15 09:02:16.894552 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 449/848] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:16 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1664 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:17.021942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:17.023190 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] [instance: c86cee43-cf9a-4232-8596-966bef68ed90] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:17.030437 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:17.030885 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:17.031649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:17.032084 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:17.080788 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] HTTP exception thrown: Instance c86cee43-cf9a-4232-8596-966bef68ed90 could not be found. Sep 15 09:02:17.081381 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] Returning 404 to user: Instance c86cee43-cf9a-4232-8596-966bef68ed90 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:02:17.082220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0d70bbbe-acf7-469d-b647-f23dac2551aa tempest-VolumesSnapshotTestJSON-1429785855 tempest-VolumesSnapshotTestJSON-1429785855-project] 10.222.0.39 "GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90" status: 404 len: 111 microversion: 2.1 time: 0.069426 Sep 15 09:02:17.082752 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 400/849] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:17 2021] GET /compute/v2.1/servers/c86cee43-cf9a-4232-8596-966bef68ed90 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:02:17.912889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:17.914171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:17.921216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:17.921646 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:17.922458 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:17.922862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:18.187171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:18.195318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d91997e7-04a9-4937-8a1f-417f2eabb3ce tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1664 microversion: 2.1 time: 0.292054 Sep 15 09:02:18.195848 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 450/850] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:17 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1664 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:19.217179 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:19.217721 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:19.226071 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:19.226648 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:19.227427 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:19.228024 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:19.452123 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:19.460738 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7d84f973-53e1-40d8-95b2-f991f03abc05 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1664 microversion: 2.1 time: 0.252034 Sep 15 09:02:19.461285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 401/851] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:19 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1664 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:20.485230 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:20.485846 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:20.493962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:20.494430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:20.495280 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:20.495701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:20.707174 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:20.715279 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8b844017-c1dd-450c-9cac-0f9aed9e8831 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1668 microversion: 2.1 time: 0.241206 Sep 15 09:02:20.715799 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 451/852] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:02:20 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:30.432099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-782f5ea1-a911-42d2-ba23-d172cf3108ca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:30.432742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-782f5ea1-a911-42d2-ba23-d172cf3108ca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:30.439935 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-782f5ea1-a911-42d2-ba23-d172cf3108ca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:30.440374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-782f5ea1-a911-42d2-ba23-d172cf3108ca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:30.441132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-782f5ea1-a911-42d2-ba23-d172cf3108ca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:30.441555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-782f5ea1-a911-42d2-ba23-d172cf3108ca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:30.511750 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-782f5ea1-a911-42d2-ba23-d172cf3108ca tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments/3aa25089-8477-4d91-9056-df91fe414c51" status: 200 len: 194 microversion: 2.20 time: 0.090347 Sep 15 09:02:30.512326 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 402/853] 10.222.0.39 () {60 vars in 1454 bytes} [Wed Sep 15 09:02:30 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments/3aa25089-8477-4d91-9056-df91fe414c51 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:02:30.628903 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-53fe40b5-2492-4eb7-adc2-1883cf40c176 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:30.630371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-53fe40b5-2492-4eb7-adc2-1883cf40c176 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:30.638009 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53fe40b5-2492-4eb7-adc2-1883cf40c176 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:30.638569 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53fe40b5-2492-4eb7-adc2-1883cf40c176 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:30.639394 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53fe40b5-2492-4eb7-adc2-1883cf40c176 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:30.639899 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53fe40b5-2492-4eb7-adc2-1883cf40c176 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:31.040255 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-53fe40b5-2492-4eb7-adc2-1883cf40c176 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments/3aa25089-8477-4d91-9056-df91fe414c51" status: 202 len: 0 microversion: 2.20 time: 0.421412 Sep 15 09:02:31.040826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 452/854] 10.222.0.39 () {60 vars in 1457 bytes} [Wed Sep 15 09:02:30 2021] DELETE /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments/3aa25089-8477-4d91-9056-df91fe414c51 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:02:31.055133 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-104510f9-5198-4264-b216-a6d8fb1873b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:31.056297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-104510f9-5198-4264-b216-a6d8fb1873b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:31.063981 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-104510f9-5198-4264-b216-a6d8fb1873b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:31.064416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-104510f9-5198-4264-b216-a6d8fb1873b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:31.065190 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-104510f9-5198-4264-b216-a6d8fb1873b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:31.065621 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-104510f9-5198-4264-b216-a6d8fb1873b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:31.141655 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-104510f9-5198-4264-b216-a6d8fb1873b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096070 Sep 15 09:02:31.144345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 403/855] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Sep 15 09:02:31 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:02:32.168885 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cb1893bf-0ba4-4c95-9de0-6d313404f9c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:32.168885 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cb1893bf-0ba4-4c95-9de0-6d313404f9c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:32.172730 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb1893bf-0ba4-4c95-9de0-6d313404f9c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:32.173278 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb1893bf-0ba4-4c95-9de0-6d313404f9c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:32.174207 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb1893bf-0ba4-4c95-9de0-6d313404f9c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:32.174741 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cb1893bf-0ba4-4c95-9de0-6d313404f9c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:32.253864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cb1893bf-0ba4-4c95-9de0-6d313404f9c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102771 Sep 15 09:02:32.254880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 453/856] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Sep 15 09:02:32 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:02:33.271687 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-da269ba5-eb51-4d29-9482-881d43ec7653 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:33.272595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-da269ba5-eb51-4d29-9482-881d43ec7653 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:33.279804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da269ba5-eb51-4d29-9482-881d43ec7653 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:33.280243 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da269ba5-eb51-4d29-9482-881d43ec7653 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:33.281030 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da269ba5-eb51-4d29-9482-881d43ec7653 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:33.281455 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da269ba5-eb51-4d29-9482-881d43ec7653 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:33.350983 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-da269ba5-eb51-4d29-9482-881d43ec7653 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.088827 Sep 15 09:02:33.355783 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 404/857] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Sep 15 09:02:33 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:02:33.464818 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:33.465371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:33.472502 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:33.472886 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:33.473660 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:33.474107 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:33.541947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:02:33.965537 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b1ca6756-dbf9-41f2-96d8-e811afb66db6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 204 len: 0 microversion: 2.20 time: 0.509828 Sep 15 09:02:33.966300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 454/858] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Sep 15 09:02:33 2021] DELETE /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 09:02:33.980330 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:33.980938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:33.988474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:33.988916 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:33.989695 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:33.990149 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:34.441828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:34.455932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:34.462175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:34.463298 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8305acea-4e5c-4de1-b382-be63ea97afa8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.492905 Sep 15 09:02:34.463814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 405/859] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:33 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:35.487166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:35.487849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:35.495154 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:35.495592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:35.496341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:35.496767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:35.706417 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:35.720350 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:35.727768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:35.728917 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c07b2919-877e-40ed-8ffc-3bbb85a210bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.251276 Sep 15 09:02:35.729438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 455/860] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:35 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:36.752358 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:36.752954 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:36.759990 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:36.760427 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:36.761295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:36.761583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:36.965854 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:36.979747 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:36.985920 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:36.986967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8ad984b3-9b18-42f1-9e8e-ef68dae0c3a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.243731 Sep 15 09:02:36.987472 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 406/861] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:36 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:02:38.010768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:38.011312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:38.018663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:38.019102 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:38.019859 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:38.020285 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:38.228814 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:38.242711 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:38.248847 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:38.249934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-716a807a-b58f-4f28-9f1f-de08528da4cc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.248570 Sep 15 09:02:38.250670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 456/862] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:38 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:39.276289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:39.276289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:39.292313 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:39.294477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:39.295649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:39.301072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:39.889681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:39.905081 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:39.911252 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:39.918220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-51d21817-7062-44c9-a6c4-ba1ca1fd9da1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1723 microversion: 2.20 time: 0.649042 Sep 15 09:02:39.918220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 407/863] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:39 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1723 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:02:40.384890 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-aecabdfe-ac77-43c6-9f33-904c7553cb16 req-bb267675-693a-4f97-8688-65b3e702cd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba14ca7-eb88-437e-9c49-5101925f639b", "name": "network-vif-deleted", "tag": "314b817f-9c79-46cf-a672-a625eea4af10"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:02:40.391342 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:02:40.391342 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:02:40.400230 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-aecabdfe-ac77-43c6-9f33-904c7553cb16 req-bb267675-693a-4f97-8688-65b3e702cd84 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:40.400828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-aecabdfe-ac77-43c6-9f33-904c7553cb16 req-bb267675-693a-4f97-8688-65b3e702cd84 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:40.417115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-aecabdfe-ac77-43c6-9f33-904c7553cb16 req-bb267675-693a-4f97-8688-65b3e702cd84 service nova] Creating event network-vif-deleted:314b817f-9c79-46cf-a672-a625eea4af10 for instance 5ba14ca7-eb88-437e-9c49-5101925f639b on hv-cinder-80600 Sep 15 09:02:40.421929 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-aecabdfe-ac77-43c6-9f33-904c7553cb16 req-bb267675-693a-4f97-8688-65b3e702cd84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046531 Sep 15 09:02:40.422578 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 457/864] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:02:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:02:40.938198 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:40.938806 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:40.946755 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:40.947576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:40.948094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:40.948949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:41.042452 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:41.043009 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:41.043536 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lazy-loading 'fault' on Instance uuid 5ba14ca7-eb88-437e-9c49-5101925f639b {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:02:41.559383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:41.579060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:41.588177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:41.589486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9f5fc619-e791-46b1-9e09-68172e05252c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 200 len: 1371 microversion: 2.20 time: 0.662054 Sep 15 09:02:41.590110 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 408/865] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:40 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 1371 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:42.614647 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:42.615333 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:42.623149 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:42.627856 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:42.627856 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:42.627856 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:42.676115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] HTTP exception thrown: Instance 5ba14ca7-eb88-437e-9c49-5101925f639b could not be found. Sep 15 09:02:42.676701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Returning 404 to user: Instance 5ba14ca7-eb88-437e-9c49-5101925f639b could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:02:42.677516 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0a4cec77-e90d-490c-9d7f-175cc5b8daa5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 404 len: 111 microversion: 2.20 time: 0.072967 Sep 15 09:02:42.678052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 458/866] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:42 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 09:02:42.692314 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b127d348-7288-4cd2-9d64-8cee9fbecaac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '.version_select at 0x7f1ec6587d30>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:42.792612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b127d348-7288-4cd2-9d64-8cee9fbecaac tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109361204" status: 204 len: 0 microversion: 2.20 time: 0.109510 Sep 15 09:02:42.793371 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 409/867] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Sep 15 09:02:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109361204 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 09:02:44.272803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-47705880-64e2-4d8b-a4a8-ed07eafb71df tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'create', calling method: .version_select at 0x7f1ec688fd30>, body: {"keypair": {"name": "tempest-keypair-1276257989"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:02:44.300689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-47705880-64e2-4d8b-a4a8-ed07eafb71df tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:02:44.305038 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-47705880-64e2-4d8b-a4a8-ed07eafb71df tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for user 662bcbb9a7fc49e8b1b2a3f4d8a2e100 and project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:02:44.700795 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-47705880-64e2-4d8b-a4a8-ed07eafb71df tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:02:44.704570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-47705880-64e2-4d8b-a4a8-ed07eafb71df tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for user 662bcbb9a7fc49e8b1b2a3f4d8a2e100 and project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:02:44.719152 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-47705880-64e2-4d8b-a4a8-ed07eafb71df tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.455600 Sep 15 09:02:44.719735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 459/868] 10.222.0.39 () {62 vars in 1199 bytes} [Wed Sep 15 09:02:44 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 457 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 15 09:02:47.428071 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-675640369", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dee31690-1b17-41a7-9226-bbc0b9faff0c"}], "security_groups": [{"name": "tempest-securitygroup--520767412"}], "key_name": "tempest-keypair-1276257989", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:02:47.672761 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] validate_networks() for [('dee31690-1b17-41a7-9226-bbc0b9faff0c', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:02:48.439960 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:02:48.440560 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:02:48.440859 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:02:48.441263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:02:48.441673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:02:48.449908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:48.450385 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:48.451184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:48.451615 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:48.468204 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:02:48.472337 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Getting quotas for user 662bcbb9a7fc49e8b1b2a3f4d8a2e100 and project 5f168b6f24dc4d93824606ca9470fea0. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:02:48.483242 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:02:48.485495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:02:48.630440 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-92d68c40-ccae-4613-9048-d971081b7c01 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.211977 Sep 15 09:02:48.631071 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 410/869] 10.222.0.39 () {62 vars in 1188 bytes} [Wed Sep 15 09:02:47 2021] POST /compute/v2.1/servers => generated 401 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 09:02:48.638590 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 09:02:48.648603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d00f0b7a-58b4-453f-ad3a-10ded80b2107 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:48.649212 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d00f0b7a-58b4-453f-ad3a-10ded80b2107 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:48.883115 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d00f0b7a-58b4-453f-ad3a-10ded80b2107 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:48.895858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d00f0b7a-58b4-453f-ad3a-10ded80b2107 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:48.902890 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d00f0b7a-58b4-453f-ad3a-10ded80b2107 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:48.903939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d00f0b7a-58b4-453f-ad3a-10ded80b2107 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1281 microversion: 2.20 time: 0.266874 Sep 15 09:02:48.904456 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 460/870] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:48 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:49.928096 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:49.929515 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:49.937038 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:49.937477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:49.938263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:49.938686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:50.063331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:50.076846 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:50.083188 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:50.084393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e4bd1344-cc9e-4efd-a3dd-2ac4510f07c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1277 microversion: 2.20 time: 0.166144 Sep 15 09:02:50.084915 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 411/871] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:49 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:51.112092 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:51.113503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:51.134018 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:51.134749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:51.135911 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:51.136852 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:51.203710 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43420. Sep 15 09:02:51.299814 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:51.339040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:51.348797 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:51.349950 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f7628e45-ba7f-41cf-a8f4-5164b239b506 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1351 microversion: 2.20 time: 0.251199 Sep 15 09:02:51.360256 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 461/872] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:51 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1351 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:52.379976 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:52.380541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:52.388268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:52.388773 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:52.389718 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:52.390189 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:52.829281 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:52.846878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:52.853646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:52.855099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1366ba5d-6824-4e8d-8088-78837144ece1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.485459 Sep 15 09:02:52.856150 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 412/873] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:52 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:53.881931 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:53.882600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:53.892672 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:53.893340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:53.894122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:53.894556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:54.010416 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-36adef42-cab3-4450-9ea8-6147c519d753 req-a67f01fe-8b3d-4729-9c99-e8ae6f7c757a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea6d38f-dd74-452c-b2ad-51db3fe58d6e", "tag": "e9ff7f1c-60ef-492f-a949-c6144ac7bdcb"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:02:54.018833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:02:54.018833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:02:54.030306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-36adef42-cab3-4450-9ea8-6147c519d753 req-a67f01fe-8b3d-4729-9c99-e8ae6f7c757a service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:54.030877 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-36adef42-cab3-4450-9ea8-6147c519d753 req-a67f01fe-8b3d-4729-9c99-e8ae6f7c757a service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:54.049223 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-36adef42-cab3-4450-9ea8-6147c519d753 req-a67f01fe-8b3d-4729-9c99-e8ae6f7c757a service nova] Creating event network-changed:e9ff7f1c-60ef-492f-a949-c6144ac7bdcb for instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e on hv-cinder-80600 Sep 15 09:02:54.054531 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-36adef42-cab3-4450-9ea8-6147c519d753 req-a67f01fe-8b3d-4729-9c99-e8ae6f7c757a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058821 Sep 15 09:02:54.056210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 413/874] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:02:54.299865 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:54.333976 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:54.341471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:54.342828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6731f877-bc56-4aaa-8cd4-07d654956f91 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.473075 Sep 15 09:02:54.343814 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 462/875] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:53 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:55.375346 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:55.376046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:55.386863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:55.387554 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:55.388344 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:55.389105 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:55.629705 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:55.644752 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:55.652949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:55.654067 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d70ed315-0425-4a7e-bfe3-09800f2886b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.291910 Sep 15 09:02:55.654605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 414/876] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:55 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:56.677553 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:56.678193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:56.685983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:56.686457 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:56.687228 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:56.687657 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:56.888674 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:56.902612 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:56.908832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:56.909865 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-499b1fbe-15d6-4a6b-89cf-500157e23562 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.241724 Sep 15 09:02:56.910415 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 463/877] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:56 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:57.933838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:57.935143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:57.942762 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:57.943276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:57.944121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:57.944614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:58.160538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:58.175794 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:58.183333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:58.185414 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a4f2fb81-a3a5-4515-bea1-e1170797926c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.260250 Sep 15 09:02:58.185414 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 415/878] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:57 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:02:59.207055 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:02:59.207657 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:02:59.215370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:59.215910 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:59.216973 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:02:59.217408 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:02:59.423752 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:59.436899 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:59.447670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:02:59.447670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5d19e52a-dd27-403b-a8d4-1b5b5c581a16 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.246222 Sep 15 09:02:59.447670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 464/879] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:02:59 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:00.465742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:00.466354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:00.473518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:00.473953 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:00.474820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:00.475241 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:00.685832 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:00.699474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:00.705902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:00.706934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5b13ab50-26a5-45f6-bcbb-5c2db0bf1f44 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.250307 Sep 15 09:03:00.707451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 416/880] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:00 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:01.196498 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a63fead1-02ee-40af-ab29-ceaa2dcbaf5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:01.197489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a63fead1-02ee-40af-ab29-ceaa2dcbaf5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:01.205601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a63fead1-02ee-40af-ab29-ceaa2dcbaf5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.205601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a63fead1-02ee-40af-ab29-ceaa2dcbaf5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.206576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a63fead1-02ee-40af-ab29-ceaa2dcbaf5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.207002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a63fead1-02ee-40af-ab29-ceaa2dcbaf5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.281294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a63fead1-02ee-40af-ab29-ceaa2dcbaf5b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094304 Sep 15 09:03:01.286969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 465/881] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:03:01 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:01.392548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:01.393029 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:01.400122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.400556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.401795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.402309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.470500 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:03:01.730600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:01.731196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:01.738468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.738805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.739567 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.739988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.807671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-098584b5-6a5e-46ab-a3e3-738fbe119abf tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 204 len: 0 microversion: 2.1 time: 0.423848 Sep 15 09:03:01.808243 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 417/882] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:03:01 2021] DELETE /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:03:01.822644 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:01.828970 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:01.831502 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.832012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.832817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:01.833253 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:01.981468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:01.996569 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:02.003485 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:02.004764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2dcef70e-a2a9-4474-a142-11398242f7c4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.283880 Sep 15 09:03:02.006841 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 466/883] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:01 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:03:02.060742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:02.068734 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-70d3827f-ce1b-4662-b12e-44e098839a8d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1674 microversion: 2.1 time: 0.255601 Sep 15 09:03:02.069254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 418/884] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:01 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:03.027888 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:03.028458 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:03.035566 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:03.036011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:03.036785 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:03.037208 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:03.090044 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:03.091174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:03.098634 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:03.099071 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:03.099836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:03.100262 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:03.243314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:03.257336 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:03.263966 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:03.265045 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dcae1135-cd38-464c-a774-9a5ef42463b0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.246365 Sep 15 09:03:03.265556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 467/885] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:03 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:03.308804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:03.317447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5e29c8e1-6345-4d85-9f09-b47bbd1f6923 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1674 microversion: 2.1 time: 0.236598 Sep 15 09:03:03.325858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 419/886] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:03 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:04.288626 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:04.289184 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:04.296860 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:04.297297 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:04.298040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:04.298495 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:04.339636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:04.340239 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:04.347468 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:04.347914 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:04.348684 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:04.349112 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:04.557476 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:04.571791 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:04.578368 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:04.579475 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6eab6377-b149-41b6-94bb-d86485e8815d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.300151 Sep 15 09:03:04.580122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 468/887] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:04 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:04.651676 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:04.659719 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-76c98ea4-600d-4ea0-96c4-71518ae33756 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1674 microversion: 2.1 time: 0.329819 Sep 15 09:03:04.660408 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 420/888] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:04 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1674 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:05.603973 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:05.604590 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:05.611685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:05.612127 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:05.612894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:05.613324 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:05.827610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:05.843272 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:05.849824 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:05.850945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8f142979-28b2-45ca-a948-6072720d385b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.256285 Sep 15 09:03:05.851470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 469/889] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:05 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:05.906569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:05.906569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:05.912619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:05.913072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:05.913843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:05.917251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:06.139232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:06.148332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ccdb085e-2254-4ffa-b945-af876dc7c8f9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1674 microversion: 2.1 time: 0.475374 Sep 15 09:03:06.154992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 421/890] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:05 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1674 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:06.446903 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-37132652-cedd-4e95-99aa-fd1e3a5c1841 req-f03f84af-4bda-49ca-a760-b408c4b6f15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea6d38f-dd74-452c-b2ad-51db3fe58d6e", "name": "network-vif-plugged", "status": "completed", "tag": "e9ff7f1c-60ef-492f-a949-c6144ac7bdcb"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:06.453385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:03:06.453385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:03:06.464061 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-37132652-cedd-4e95-99aa-fd1e3a5c1841 req-f03f84af-4bda-49ca-a760-b408c4b6f15d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:06.464835 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-37132652-cedd-4e95-99aa-fd1e3a5c1841 req-f03f84af-4bda-49ca-a760-b408c4b6f15d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:06.481176 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-37132652-cedd-4e95-99aa-fd1e3a5c1841 req-f03f84af-4bda-49ca-a760-b408c4b6f15d service nova] Creating event network-vif-plugged:e9ff7f1c-60ef-492f-a949-c6144ac7bdcb for instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e on hv-cinder-80600 Sep 15 09:03:06.491538 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-37132652-cedd-4e95-99aa-fd1e3a5c1841 req-f03f84af-4bda-49ca-a760-b408c4b6f15d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059854 Sep 15 09:03:06.492388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 470/891] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:03:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:03:06.874533 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:06.875552 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:06.891526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:06.892106 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:06.893142 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:06.893807 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:07.177852 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:07.178593 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:07.186806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:07.187358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:07.188456 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:07.189146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:07.410318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:07.419143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ebd9f4ae-d62d-42cf-8b9d-c15e62c28a99 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1674 microversion: 2.1 time: 0.252391 Sep 15 09:03:07.419678 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 471/892] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:07 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1674 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:07.444567 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:07.458426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:07.465716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:07.466936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d635ada4-c0ba-46ca-ad8a-a819f167e618 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1406 microversion: 2.20 time: 0.601779 Sep 15 09:03:07.467562 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 422/893] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:06 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1406 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:08.443787 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:08.445044 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:08.453143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:08.454016 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:08.455029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:08.455729 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:08.627344 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:08.657035 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f283e2f5-6c10-487b-a877-c40c933c830f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1606 microversion: 2.1 time: 0.224145 Sep 15 09:03:08.666820 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 472/894] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:08 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1606 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:08.695426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-76b9283b-ac74-4d0e-b0b6-d317c6897761 req-26122d22-600e-46e0-871a-2c57fa8af779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661af67d-f3ef-4c65-bcb6-a51b229ddbf0", "name": "network-vif-deleted", "tag": "afdabbd5-43b9-4136-8495-2bdae211bde3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:08.711244 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:03:08.711244 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:03:08.725548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-76b9283b-ac74-4d0e-b0b6-d317c6897761 req-26122d22-600e-46e0-871a-2c57fa8af779 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:08.726126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-76b9283b-ac74-4d0e-b0b6-d317c6897761 req-26122d22-600e-46e0-871a-2c57fa8af779 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:08.750507 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-76b9283b-ac74-4d0e-b0b6-d317c6897761 req-26122d22-600e-46e0-871a-2c57fa8af779 service nova] Creating event network-vif-deleted:afdabbd5-43b9-4136-8495-2bdae211bde3 for instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 on hv-cinder-80600 Sep 15 09:03:08.760149 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-76b9283b-ac74-4d0e-b0b6-d317c6897761 req-26122d22-600e-46e0-871a-2c57fa8af779 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090505 Sep 15 09:03:08.762248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 473/895] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:03:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:03:08.939651 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:08.940876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:08.954466 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:08.955001 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:08.955896 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:08.956384 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:09.183845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:09.197170 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:09.203437 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:09.204535 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-222bceff-93d4-4d4f-bc1c-7bd9dcf6cde3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1597 microversion: 2.20 time: 0.723153 Sep 15 09:03:09.205052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 423/896] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:08 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1597 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:03:09.228414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b87cb3dd-4909-461d-8dbc-45ffa243e994 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:09.229076 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b87cb3dd-4909-461d-8dbc-45ffa243e994 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:09.237208 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b87cb3dd-4909-461d-8dbc-45ffa243e994 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:09.237938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b87cb3dd-4909-461d-8dbc-45ffa243e994 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:09.238812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b87cb3dd-4909-461d-8dbc-45ffa243e994 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:09.239576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b87cb3dd-4909-461d-8dbc-45ffa243e994 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:09.396774 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b87cb3dd-4909-461d-8dbc-45ffa243e994 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.178142 Sep 15 09:03:09.397703 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 474/897] 10.222.0.39 () {60 vars in 1316 bytes} [Wed Sep 15 09:03:09 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:09.696022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:09.697041 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:09.713014 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:09.713576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:09.714521 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:09.718451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:09.834298 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:09.834772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:09.835350 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lazy-loading 'fault' on Instance uuid 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:03:10.073608 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:10.081571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-42be80a6-81ae-40ac-bd5d-56da34ab9b87 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 200 len: 1326 microversion: 2.1 time: 0.405017 Sep 15 09:03:10.082132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 424/898] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:09 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 1326 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:11.114002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:11.114656 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:11.125462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:11.126077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:11.127263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:11.128049 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:11.190382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] HTTP exception thrown: Instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 could not be found. Sep 15 09:03:11.191197 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Returning 404 to user: Instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:03:11.192404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e763e691-4654-4f02-8483-0340478b7615 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 404 len: 111 microversion: 2.1 time: 0.088830 Sep 15 09:03:11.192939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 475/899] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:11 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:03:11.206864 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7eefb5d3-e108-4697-bbcd-fe8a281c929c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '.version_select at 0x7f1ec65879d0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:11.271886 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7eefb5d3-e108-4697-bbcd-fe8a281c929c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152583117" status: 202 len: 0 microversion: 2.1 time: 0.074346 Sep 15 09:03:11.272454 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 425/900] 10.222.0.39 () {58 vars in 1218 bytes} [Wed Sep 15 09:03:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152583117 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:11.492291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-87bead9b-c704-484a-82b2-e14493258775 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:11.501589 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-87bead9b-c704-484a-82b2-e14493258775 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:11.514341 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-87bead9b-c704-484a-82b2-e14493258775 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:11.514789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-87bead9b-c704-484a-82b2-e14493258775 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:11.515579 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-87bead9b-c704-484a-82b2-e14493258775 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:11.516161 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-87bead9b-c704-484a-82b2-e14493258775 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:11.686389 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-116298df-2148-480a-a8d5-bd1e14cce9b0 req-98e4a45d-6103-44b1-b17e-42ccb2d2e8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea6d38f-dd74-452c-b2ad-51db3fe58d6e", "tag": "e9ff7f1c-60ef-492f-a949-c6144ac7bdcb"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:11.693414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-87bead9b-c704-484a-82b2-e14493258775 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 0.210651 Sep 15 09:03:11.693414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 476/901] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:11 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:11.702297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:03:11.702297 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:03:11.709136 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-116298df-2148-480a-a8d5-bd1e14cce9b0 req-98e4a45d-6103-44b1-b17e-42ccb2d2e8af service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:11.709630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-116298df-2148-480a-a8d5-bd1e14cce9b0 req-98e4a45d-6103-44b1-b17e-42ccb2d2e8af service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:11.726660 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-116298df-2148-480a-a8d5-bd1e14cce9b0 req-98e4a45d-6103-44b1-b17e-42ccb2d2e8af service nova] Creating event network-changed:e9ff7f1c-60ef-492f-a949-c6144ac7bdcb for instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e on hv-cinder-80600 Sep 15 09:03:11.731626 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-116298df-2148-480a-a8d5-bd1e14cce9b0 req-98e4a45d-6103-44b1-b17e-42ccb2d2e8af service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244980 Sep 15 09:03:11.732291 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 426/902] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:03:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:03:12.717930 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e90b5863-92a8-4b0b-bd02-9eafd755231b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:12.720695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e90b5863-92a8-4b0b-bd02-9eafd755231b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:12.732870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e90b5863-92a8-4b0b-bd02-9eafd755231b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:12.733776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e90b5863-92a8-4b0b-bd02-9eafd755231b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:12.734927 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e90b5863-92a8-4b0b-bd02-9eafd755231b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:12.735731 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e90b5863-92a8-4b0b-bd02-9eafd755231b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:12.878267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e90b5863-92a8-4b0b-bd02-9eafd755231b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 0.172740 Sep 15 09:03:12.879019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 477/903] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:12 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:13.134779 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4fddab2f-b396-40b2-9d55-ef9af64e1d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'create', calling method: .version_select at 0x7f1ec68cb280>, body: {"keypair": {"name": "tempest-keypair-50648367"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:13.180092 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-4fddab2f-b396-40b2-9d55-ef9af64e1d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:03:13.185713 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-4fddab2f-b396-40b2-9d55-ef9af64e1d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for user e26e692f5f7d4c8cb7dd9c0207ecf68f and project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:03:13.529478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-4fddab2f-b396-40b2-9d55-ef9af64e1d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:03:13.533475 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-4fddab2f-b396-40b2-9d55-ef9af64e1d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for user e26e692f5f7d4c8cb7dd9c0207ecf68f and project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:03:13.546878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4fddab2f-b396-40b2-9d55-ef9af64e1d28 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.422122 Sep 15 09:03:13.547458 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 427/904] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Sep 15 09:03:13 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:13.894903 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1341e27e-36aa-4fdf-80d2-355a516b836b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:13.896604 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1341e27e-36aa-4fdf-80d2-355a516b836b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:13.905345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1341e27e-36aa-4fdf-80d2-355a516b836b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:13.905790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1341e27e-36aa-4fdf-80d2-355a516b836b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:13.906586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1341e27e-36aa-4fdf-80d2-355a516b836b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:13.907011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1341e27e-36aa-4fdf-80d2-355a516b836b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:14.046608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1341e27e-36aa-4fdf-80d2-355a516b836b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 0.160531 Sep 15 09:03:14.052198 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 478/905] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:13 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:15.071941 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-cbdb657f-2f0c-4d6b-a1b1-5da6c0df36e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:15.073214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-cbdb657f-2f0c-4d6b-a1b1-5da6c0df36e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:15.080882 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbdb657f-2f0c-4d6b-a1b1-5da6c0df36e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:15.081438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbdb657f-2f0c-4d6b-a1b1-5da6c0df36e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:15.082466 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbdb657f-2f0c-4d6b-a1b1-5da6c0df36e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:15.082968 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-cbdb657f-2f0c-4d6b-a1b1-5da6c0df36e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:15.225431 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-cbdb657f-2f0c-4d6b-a1b1-5da6c0df36e5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 0.168820 Sep 15 09:03:15.228693 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 428/906] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:15 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:16.242556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a4109bfd-6a87-4bec-a668-9a3dfdc8c39b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:16.243571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a4109bfd-6a87-4bec-a668-9a3dfdc8c39b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:16.252049 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a4109bfd-6a87-4bec-a668-9a3dfdc8c39b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:16.252676 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a4109bfd-6a87-4bec-a668-9a3dfdc8c39b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:16.253490 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a4109bfd-6a87-4bec-a668-9a3dfdc8c39b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:16.253926 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a4109bfd-6a87-4bec-a668-9a3dfdc8c39b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:16.377378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a4109bfd-6a87-4bec-a668-9a3dfdc8c39b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 0.144492 Sep 15 09:03:16.380712 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 479/907] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:16 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:16.432647 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-455308328", "imageRef": "f25e1690-14f1-43dc-9800-bfbfae5b817e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a7d9519-adcd-45df-bd0a-0005f95484a0"}], "security_groups": [{"name": "tempest-securitygroup--962569642"}], "key_name": "tempest-keypair-50648367", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:16.669853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] validate_networks() for [('2a7d9519-adcd-45df-bd0a-0005f95484a0', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:03:17.275489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:03:17.276755 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:03:17.277255 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:03:17.277683 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:03:17.278103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:03:17.286316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:17.286789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:17.287575 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:17.288242 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:17.305631 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:03:17.309866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Getting quotas for user e26e692f5f7d4c8cb7dd9c0207ecf68f and project 1aadda57f2be49a592d2dc246c4ce0ed. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:03:17.320685 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:03:17.323245 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f25e1690-14f1-43dc-9800-bfbfae5b817e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:03:17.394617 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1d1718e9-0694-4db6-b151-7124f9f79d7d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:17.395614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1d1718e9-0694-4db6-b151-7124f9f79d7d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:17.404564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d1718e9-0694-4db6-b151-7124f9f79d7d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:17.405066 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d1718e9-0694-4db6-b151-7124f9f79d7d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:17.405852 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d1718e9-0694-4db6-b151-7124f9f79d7d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:17.406314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d1718e9-0694-4db6-b151-7124f9f79d7d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:17.453388 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1f411099-f05e-45d7-b8d3-b884b13f27fb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.030771 Sep 15 09:03:17.454649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 429/908] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:03:16 2021] POST /compute/v2.1/servers => generated 401 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 09:03:17.480422 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b6984871-9abc-4754-bf23-31ecca1dd464 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:17.481097 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b6984871-9abc-4754-bf23-31ecca1dd464 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:17.535830 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1d1718e9-0694-4db6-b151-7124f9f79d7d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 0.150585 Sep 15 09:03:17.537141 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 480/909] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:17 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:17.580674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b6984871-9abc-4754-bf23-31ecca1dd464 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:17.589820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b6984871-9abc-4754-bf23-31ecca1dd464 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1235 microversion: 2.1 time: 0.129230 Sep 15 09:03:17.598254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 430/910] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:17 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1235 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:18.554226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-178daaf6-e869-4dc6-9ea7-7244db6209f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:18.555347 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-178daaf6-e869-4dc6-9ea7-7244db6209f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:18.564409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-178daaf6-e869-4dc6-9ea7-7244db6209f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:18.564848 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-178daaf6-e869-4dc6-9ea7-7244db6209f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:18.565622 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-178daaf6-e869-4dc6-9ea7-7244db6209f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:18.566043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-178daaf6-e869-4dc6-9ea7-7244db6209f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:18.611395 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:18.611967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:18.621399 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:18.621986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:18.622894 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:18.623571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:18.742479 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:18.750897 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-72fa3d3f-56f0-44c0-8e3d-1412316763d9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1239 microversion: 2.1 time: 0.148703 Sep 15 09:03:18.751426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 431/911] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:18 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1239 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:19.772511 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:19.773323 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:19.784511 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:19.784988 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:19.785750 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:19.786202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:19.906928 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:19.914910 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5ce77352-4f42-4bed-99c1-7096ed8ca8be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1239 microversion: 2.1 time: 0.151541 Sep 15 09:03:19.915425 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 432/912] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:19 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1239 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:20.937158 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:20.937805 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:20.945077 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:20.945515 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:20.946298 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:20.946726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:21.068289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:21.077032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bf0c8e96-69e7-40aa-b24c-1581aacbcdd7 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1239 microversion: 2.1 time: 0.149387 Sep 15 09:03:21.077570 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 433/913] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:20 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1239 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:21.207283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-178daaf6-e869-4dc6-9ea7-7244db6209f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 2.663788 Sep 15 09:03:21.207932 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 481/914] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:18 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:22.098510 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:22.099121 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:22.106730 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:22.107172 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:22.107941 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:22.108367 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:22.224776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ab37b997-f871-41ef-846d-005031a81822 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:22.227001 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ab37b997-f871-41ef-846d-005031a81822 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:22.233803 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:22.235134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab37b997-f871-41ef-846d-005031a81822 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:22.235774 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab37b997-f871-41ef-846d-005031a81822 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:22.236697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab37b997-f871-41ef-846d-005031a81822 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:22.237276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab37b997-f871-41ef-846d-005031a81822 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:22.244507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f65bd995-9e30-4d38-8897-14d644026284 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1287 microversion: 2.1 time: 0.155166 Sep 15 09:03:22.244869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 434/915] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:22 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:22.403699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ab37b997-f871-41ef-846d-005031a81822 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 14 microversion: 2.20 time: 0.189300 Sep 15 09:03:22.404248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 482/916] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:22 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:23.266314 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:23.266919 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:23.274117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:23.274772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:23.275545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:23.275973 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:23.429614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-859c40cf-f4a7-45b0-81fa-0caf335bb98f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:23.429614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-859c40cf-f4a7-45b0-81fa-0caf335bb98f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:23.430205 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-859c40cf-f4a7-45b0-81fa-0caf335bb98f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:23.430205 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-859c40cf-f4a7-45b0-81fa-0caf335bb98f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:23.430892 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-859c40cf-f4a7-45b0-81fa-0caf335bb98f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:23.431319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-859c40cf-f4a7-45b0-81fa-0caf335bb98f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:23.558335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-859c40cf-f4a7-45b0-81fa-0caf335bb98f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 7599 microversion: 2.20 time: 0.147201 Sep 15 09:03:23.559285 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 483/917] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:23 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 7599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:03:23.640934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:23.650316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9bf9f28d-f279-471e-b95b-8cac5fbcc1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.392659 Sep 15 09:03:23.650316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 435/918] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:23 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:24.574959 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-091db944-dcf7-458f-9d0b-0cbec945ba4a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:24.576019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-091db944-dcf7-458f-9d0b-0cbec945ba4a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:24.584007 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-091db944-dcf7-458f-9d0b-0cbec945ba4a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:24.584305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-091db944-dcf7-458f-9d0b-0cbec945ba4a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:24.585083 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-091db944-dcf7-458f-9d0b-0cbec945ba4a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:24.585506 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-091db944-dcf7-458f-9d0b-0cbec945ba4a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:24.673364 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:24.674019 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:24.682138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:24.682583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:24.683345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:24.683768 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:24.725272 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-091db944-dcf7-458f-9d0b-0cbec945ba4a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 16196 microversion: 2.20 time: 0.159826 Sep 15 09:03:24.727447 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 484/919] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:24 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 16196 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 09:03:24.967846 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-691a4aa1-4d6b-493e-bb60-f818304e9cc5 req-4ff3d2bc-4b1b-4bfc-9dc6-2bfba992e25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6167b622-02e3-4984-a72d-7207ecf18083", "tag": "359c3531-b0d1-46c7-b8ca-76ca44ed7e15"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:24.974129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:03:24.974129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:03:24.982433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-691a4aa1-4d6b-493e-bb60-f818304e9cc5 req-4ff3d2bc-4b1b-4bfc-9dc6-2bfba992e25a service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:24.982875 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-691a4aa1-4d6b-493e-bb60-f818304e9cc5 req-4ff3d2bc-4b1b-4bfc-9dc6-2bfba992e25a service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:25.001390 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-691a4aa1-4d6b-493e-bb60-f818304e9cc5 req-4ff3d2bc-4b1b-4bfc-9dc6-2bfba992e25a service nova] Creating event network-changed:359c3531-b0d1-46c7-b8ca-76ca44ed7e15 for instance 6167b622-02e3-4984-a72d-7207ecf18083 on hv-cinder-80600 Sep 15 09:03:25.005713 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:25.005901 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-691a4aa1-4d6b-493e-bb60-f818304e9cc5 req-4ff3d2bc-4b1b-4bfc-9dc6-2bfba992e25a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276887 Sep 15 09:03:25.006412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 485/920] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:03:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:03:25.014389 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5b1591a1-eb6b-482c-b35e-6b191fdc89c5 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.351022 Sep 15 09:03:25.014903 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 436/921] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:24 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:25.745648 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6ceb72b1-ad8a-43f0-8d00-48d41fa26d97 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:25.746665 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6ceb72b1-ad8a-43f0-8d00-48d41fa26d97 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:25.754890 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b1-ad8a-43f0-8d00-48d41fa26d97 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:25.757994 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b1-ad8a-43f0-8d00-48d41fa26d97 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:25.757994 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b1-ad8a-43f0-8d00-48d41fa26d97 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:25.757994 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b1-ad8a-43f0-8d00-48d41fa26d97 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:25.892478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6ceb72b1-ad8a-43f0-8d00-48d41fa26d97 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 18561 microversion: 2.20 time: 0.157357 Sep 15 09:03:25.893671 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 486/922] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:25 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 18561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:26.036795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:26.037489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:26.045471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:26.046171 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:26.047129 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:26.047557 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:26.388817 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:26.397258 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-db73d94f-ffa5-4447-a337-f19d173e748e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.369606 Sep 15 09:03:26.397712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 437/923] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:26 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:26.910129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e4f59b7d-4ad1-4544-a62e-91bcb699c734 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:26.911126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e4f59b7d-4ad1-4544-a62e-91bcb699c734 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:26.918877 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4f59b7d-4ad1-4544-a62e-91bcb699c734 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:26.919321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4f59b7d-4ad1-4544-a62e-91bcb699c734 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:26.920069 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4f59b7d-4ad1-4544-a62e-91bcb699c734 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:26.920494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4f59b7d-4ad1-4544-a62e-91bcb699c734 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:27.419790 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:27.420352 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:27.427387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:27.427820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:27.428565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:27.428985 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:27.628206 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:27.636046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c1e4847d-a37c-42ff-af1e-2871c73c6fba tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.225760 Sep 15 09:03:27.636565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 438/924] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:27 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:28.657693 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:28.658381 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:28.665488 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:28.665926 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:28.667235 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:28.667659 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:28.875189 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:28.883099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b6fa4990-3338-4761-8e69-5813cd3e8109 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.234502 Sep 15 09:03:28.883613 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 439/925] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:28 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:03:29.467366 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e4f59b7d-4ad1-4544-a62e-91bcb699c734 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 24586 microversion: 2.20 time: 2.566455 Sep 15 09:03:29.471294 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 487/926] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:26 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 24586 bytes in 2568 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:29.905094 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:29.905707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:29.912848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:29.913289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:29.914048 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:29.914503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:30.121846 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:30.129720 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ade70c1c-b114-4516-a7ca-27450d37779a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.233939 Sep 15 09:03:30.130285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 440/927] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:29 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:30.485327 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-30425120-0030-47bf-ad64-eb1903872a4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:30.486347 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-30425120-0030-47bf-ad64-eb1903872a4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:30.494620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-30425120-0030-47bf-ad64-eb1903872a4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:30.495628 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-30425120-0030-47bf-ad64-eb1903872a4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:30.496392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-30425120-0030-47bf-ad64-eb1903872a4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:30.496823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-30425120-0030-47bf-ad64-eb1903872a4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:30.627290 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-30425120-0030-47bf-ad64-eb1903872a4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 26083 microversion: 2.20 time: 0.151857 Sep 15 09:03:30.628570 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 488/928] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:30 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 26083 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:31.152678 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:31.153283 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:31.160605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:31.161040 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:31.161799 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:31.162250 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:31.364988 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:31.373640 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fbe914c2-6044-4618-9e69-2894e4ba89b0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.230635 Sep 15 09:03:31.375177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 441/929] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:31 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:31.645227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9ea81212-3e1d-4710-9827-fc395906d210 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:31.646248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9ea81212-3e1d-4710-9827-fc395906d210 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:31.653998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ea81212-3e1d-4710-9827-fc395906d210 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:31.654477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ea81212-3e1d-4710-9827-fc395906d210 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:31.655237 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ea81212-3e1d-4710-9827-fc395906d210 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:31.655686 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ea81212-3e1d-4710-9827-fc395906d210 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:31.785338 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9ea81212-3e1d-4710-9827-fc395906d210 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 27322 microversion: 2.20 time: 0.150093 Sep 15 09:03:31.785947 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 489/930] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:31 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 27322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:32.397342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:32.397939 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:32.406026 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:32.406433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:32.407195 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:32.407619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:32.620712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:32.628325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-af42b983-3aba-4944-9ca7-56269bebfa4c req-d580c7da-5df4-4581-b5a4-73ab66357c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6167b622-02e3-4984-a72d-7207ecf18083", "name": "network-vif-plugged", "status": "completed", "tag": "359c3531-b0d1-46c7-b8ca-76ca44ed7e15"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:32.631682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-56ebd6e6-6d2f-4254-bc61-b24a115bf0b9 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.242870 Sep 15 09:03:32.631682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 442/931] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:32 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:32.634610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:03:32.634610 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:03:32.643592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-af42b983-3aba-4944-9ca7-56269bebfa4c req-d580c7da-5df4-4581-b5a4-73ab66357c9f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:32.644099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-af42b983-3aba-4944-9ca7-56269bebfa4c req-d580c7da-5df4-4581-b5a4-73ab66357c9f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:32.660390 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-af42b983-3aba-4944-9ca7-56269bebfa4c req-d580c7da-5df4-4581-b5a4-73ab66357c9f service nova] Creating event network-vif-plugged:359c3531-b0d1-46c7-b8ca-76ca44ed7e15 for instance 6167b622-02e3-4984-a72d-7207ecf18083 on hv-cinder-80600 Sep 15 09:03:32.664972 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-af42b983-3aba-4944-9ca7-56269bebfa4c req-d580c7da-5df4-4581-b5a4-73ab66357c9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131827 Sep 15 09:03:32.665805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 490/932] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:03:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:03:32.805811 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2a377350-c8f2-4f4f-b5a6-734d80771c84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:32.806833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2a377350-c8f2-4f4f-b5a6-734d80771c84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:32.815820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2a377350-c8f2-4f4f-b5a6-734d80771c84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:32.816252 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2a377350-c8f2-4f4f-b5a6-734d80771c84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:32.817013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2a377350-c8f2-4f4f-b5a6-734d80771c84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:32.817462 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2a377350-c8f2-4f4f-b5a6-734d80771c84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:32.945392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2a377350-c8f2-4f4f-b5a6-734d80771c84 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 27874 microversion: 2.20 time: 0.151687 Sep 15 09:03:32.946033 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 443/933] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:32 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 27874 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:33.655509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:33.656202 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:33.663515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:33.664070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:33.664722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:33.665158 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:33.867080 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:33.875412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7f2a76b5-7d20-49fa-b364-4629de0719d0 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1360 microversion: 2.1 time: 0.230392 Sep 15 09:03:33.875950 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 491/934] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:33 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:33.964052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-be7ca448-ad90-452c-8290-a416dd4d34ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:33.965949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-be7ca448-ad90-452c-8290-a416dd4d34ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:33.974132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be7ca448-ad90-452c-8290-a416dd4d34ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:33.981426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be7ca448-ad90-452c-8290-a416dd4d34ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:33.981426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be7ca448-ad90-452c-8290-a416dd4d34ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:33.981426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be7ca448-ad90-452c-8290-a416dd4d34ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:34.116300 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-be7ca448-ad90-452c-8290-a416dd4d34ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 28224 microversion: 2.20 time: 0.161716 Sep 15 09:03:34.120526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 444/935] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:33 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 28224 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:34.897222 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:34.897812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:34.904953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:34.905392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:34.906185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:34.906612 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:35.109013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:35.117295 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b857dab6-7602-484b-90e8-4aa1ecc1e3da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1546 microversion: 2.1 time: 0.228997 Sep 15 09:03:35.117821 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 492/936] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:03:34 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1546 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:03:35.134677 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6de2192f-ee42-4c76-bf93-7097ce9fb220 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:35.135674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6de2192f-ee42-4c76-bf93-7097ce9fb220 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:35.139918 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-85c8f823-9ccd-4c82-aef2-42d2bf5e59ef tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:35.140526 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-85c8f823-9ccd-4c82-aef2-42d2bf5e59ef tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:35.144211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6de2192f-ee42-4c76-bf93-7097ce9fb220 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:35.144659 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6de2192f-ee42-4c76-bf93-7097ce9fb220 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:35.145435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6de2192f-ee42-4c76-bf93-7097ce9fb220 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:35.145868 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6de2192f-ee42-4c76-bf93-7097ce9fb220 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:35.148373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85c8f823-9ccd-4c82-aef2-42d2bf5e59ef tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:35.148911 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85c8f823-9ccd-4c82-aef2-42d2bf5e59ef tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:35.149787 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85c8f823-9ccd-4c82-aef2-42d2bf5e59ef tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:35.150340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85c8f823-9ccd-4c82-aef2-42d2bf5e59ef tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:35.268968 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6de2192f-ee42-4c76-bf93-7097ce9fb220 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 28224 microversion: 2.20 time: 0.144113 Sep 15 09:03:35.273505 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 445/937] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:35 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 28224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 09:03:35.299411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-85c8f823-9ccd-4c82-aef2-42d2bf5e59ef tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169682 Sep 15 09:03:35.299986 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 493/938] 10.222.0.39 () {58 vars in 1275 bytes} [Wed Sep 15 09:03:35 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:03:36.287934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f77ce99a-57ec-4f0f-b946-ff5e2782bde7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:36.288977 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f77ce99a-57ec-4f0f-b946-ff5e2782bde7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:36.296926 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f77ce99a-57ec-4f0f-b946-ff5e2782bde7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:36.297379 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f77ce99a-57ec-4f0f-b946-ff5e2782bde7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:36.298175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f77ce99a-57ec-4f0f-b946-ff5e2782bde7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:36.298607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f77ce99a-57ec-4f0f-b946-ff5e2782bde7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:36.429851 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f77ce99a-57ec-4f0f-b946-ff5e2782bde7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 28515 microversion: 2.20 time: 0.152072 Sep 15 09:03:36.433967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 446/939] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:36 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 28515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:37.114576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0b537ca3-d71d-420d-8429-b12622ba1f29 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:37.115486 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0b537ca3-d71d-420d-8429-b12622ba1f29 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:37.129689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-09d68e43-f1d1-4c32-9644-f0f875b25cd9 req-3a69d445-24ad-490c-8dd2-c8b637e46112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6167b622-02e3-4984-a72d-7207ecf18083", "tag": "359c3531-b0d1-46c7-b8ca-76ca44ed7e15"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:37.129689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:03:37.129689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:03:37.132715 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-09d68e43-f1d1-4c32-9644-f0f875b25cd9 req-3a69d445-24ad-490c-8dd2-c8b637e46112 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:37.133159 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-09d68e43-f1d1-4c32-9644-f0f875b25cd9 req-3a69d445-24ad-490c-8dd2-c8b637e46112 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:37.135789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b537ca3-d71d-420d-8429-b12622ba1f29 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:37.136236 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b537ca3-d71d-420d-8429-b12622ba1f29 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:37.137042 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b537ca3-d71d-420d-8429-b12622ba1f29 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:37.137468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b537ca3-d71d-420d-8429-b12622ba1f29 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:37.160750 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-09d68e43-f1d1-4c32-9644-f0f875b25cd9 req-3a69d445-24ad-490c-8dd2-c8b637e46112 service nova] Creating event network-changed:359c3531-b0d1-46c7-b8ca-76ca44ed7e15 for instance 6167b622-02e3-4984-a72d-7207ecf18083 on hv-cinder-80600 Sep 15 09:03:37.168746 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-09d68e43-f1d1-4c32-9644-f0f875b25cd9 req-3a69d445-24ad-490c-8dd2-c8b637e46112 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060549 Sep 15 09:03:37.170114 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 447/940] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:03:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:03:37.284912 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0b537ca3-d71d-420d-8429-b12622ba1f29 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.167780 Sep 15 09:03:37.289387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 494/941] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:37 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:37.447594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8741c6a6-243b-4acd-bd50-33984031dd0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:37.448673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8741c6a6-243b-4acd-bd50-33984031dd0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:37.456344 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8741c6a6-243b-4acd-bd50-33984031dd0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:37.459862 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8741c6a6-243b-4acd-bd50-33984031dd0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:37.459862 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8741c6a6-243b-4acd-bd50-33984031dd0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:37.459862 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8741c6a6-243b-4acd-bd50-33984031dd0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:37.599956 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8741c6a6-243b-4acd-bd50-33984031dd0d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 28683 microversion: 2.20 time: 0.162094 Sep 15 09:03:37.604394 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 448/942] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:37 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 28683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:38.305986 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-46800d2a-6039-4577-8289-bce3e5199489 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:38.307042 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-46800d2a-6039-4577-8289-bce3e5199489 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:38.315535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-46800d2a-6039-4577-8289-bce3e5199489 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:38.316146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-46800d2a-6039-4577-8289-bce3e5199489 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:38.316969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-46800d2a-6039-4577-8289-bce3e5199489 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:38.317579 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-46800d2a-6039-4577-8289-bce3e5199489 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:38.440523 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-46800d2a-6039-4577-8289-bce3e5199489 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.147123 Sep 15 09:03:38.441330 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 495/943] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:38 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:38.617829 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b2c24f0e-f99b-4701-a223-d9ec406c8887 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:38.619013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b2c24f0e-f99b-4701-a223-d9ec406c8887 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:38.627090 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2c24f0e-f99b-4701-a223-d9ec406c8887 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:38.627612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2c24f0e-f99b-4701-a223-d9ec406c8887 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:38.628649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2c24f0e-f99b-4701-a223-d9ec406c8887 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:38.629140 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b2c24f0e-f99b-4701-a223-d9ec406c8887 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:38.752411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b2c24f0e-f99b-4701-a223-d9ec406c8887 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 28683 microversion: 2.20 time: 0.144231 Sep 15 09:03:38.753193 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 449/944] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:38 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 28683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:39.457995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e4ab78be-fa39-4927-a04b-fb59735c6ad1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:39.459019 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e4ab78be-fa39-4927-a04b-fb59735c6ad1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:39.467510 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4ab78be-fa39-4927-a04b-fb59735c6ad1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:39.467949 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4ab78be-fa39-4927-a04b-fb59735c6ad1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:39.468716 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4ab78be-fa39-4927-a04b-fb59735c6ad1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:39.469141 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e4ab78be-fa39-4927-a04b-fb59735c6ad1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:39.590948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e4ab78be-fa39-4927-a04b-fb59735c6ad1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.143064 Sep 15 09:03:39.594289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 496/945] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:39 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:39.775548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-19661a36-9a22-4b36-9cfc-f8e7abc7b1fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:39.775548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-19661a36-9a22-4b36-9cfc-f8e7abc7b1fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:39.779101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-19661a36-9a22-4b36-9cfc-f8e7abc7b1fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:39.779542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-19661a36-9a22-4b36-9cfc-f8e7abc7b1fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:39.780306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-19661a36-9a22-4b36-9cfc-f8e7abc7b1fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:39.780741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-19661a36-9a22-4b36-9cfc-f8e7abc7b1fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:39.911113 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-19661a36-9a22-4b36-9cfc-f8e7abc7b1fb tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 28683 microversion: 2.20 time: 0.150845 Sep 15 09:03:39.912065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 450/946] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:39 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 28683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:40.608176 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a56663d7-b38c-4432-89cd-26cc6231d55e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:40.609175 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a56663d7-b38c-4432-89cd-26cc6231d55e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:40.617361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a56663d7-b38c-4432-89cd-26cc6231d55e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:40.617801 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a56663d7-b38c-4432-89cd-26cc6231d55e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:40.618602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a56663d7-b38c-4432-89cd-26cc6231d55e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:40.619035 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a56663d7-b38c-4432-89cd-26cc6231d55e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:40.746099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a56663d7-b38c-4432-89cd-26cc6231d55e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.147987 Sep 15 09:03:40.749106 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 497/947] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:40 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:40.928160 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-8c83f056-2f0f-4cca-bd96-52572940a6d7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:40.929149 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-8c83f056-2f0f-4cca-bd96-52572940a6d7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:40.936917 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c83f056-2f0f-4cca-bd96-52572940a6d7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:40.937361 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c83f056-2f0f-4cca-bd96-52572940a6d7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:40.938129 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c83f056-2f0f-4cca-bd96-52572940a6d7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:40.938560 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-8c83f056-2f0f-4cca-bd96-52572940a6d7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:41.084174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-8c83f056-2f0f-4cca-bd96-52572940a6d7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 30210 microversion: 2.20 time: 0.165433 Sep 15 09:03:41.084960 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 451/948] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:40 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 30210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:41.762346 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ef90cf66-d6d3-459a-9537-8873a1afc472 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:41.763340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ef90cf66-d6d3-459a-9537-8873a1afc472 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:41.771058 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef90cf66-d6d3-459a-9537-8873a1afc472 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:41.771492 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef90cf66-d6d3-459a-9537-8873a1afc472 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:41.772246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef90cf66-d6d3-459a-9537-8873a1afc472 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:41.772670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef90cf66-d6d3-459a-9537-8873a1afc472 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:41.896021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ef90cf66-d6d3-459a-9537-8873a1afc472 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.143502 Sep 15 09:03:41.896615 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 498/949] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:41 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:42.101765 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c63e2ece-19c8-436f-9b92-57b32409510a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:42.102977 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c63e2ece-19c8-436f-9b92-57b32409510a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:42.112802 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c63e2ece-19c8-436f-9b92-57b32409510a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:42.113327 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c63e2ece-19c8-436f-9b92-57b32409510a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:42.114130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c63e2ece-19c8-436f-9b92-57b32409510a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:42.114565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c63e2ece-19c8-436f-9b92-57b32409510a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:42.382355 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c63e2ece-19c8-436f-9b92-57b32409510a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 32357 microversion: 2.20 time: 0.289997 Sep 15 09:03:42.382899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 452/950] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:42 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 32357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:42.913484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bd60a526-7b10-4aee-bd99-ab7187c1a142 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:42.914518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bd60a526-7b10-4aee-bd99-ab7187c1a142 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:42.922284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bd60a526-7b10-4aee-bd99-ab7187c1a142 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:42.922728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bd60a526-7b10-4aee-bd99-ab7187c1a142 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:42.923489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bd60a526-7b10-4aee-bd99-ab7187c1a142 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:42.923914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bd60a526-7b10-4aee-bd99-ab7187c1a142 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:43.041845 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bd60a526-7b10-4aee-bd99-ab7187c1a142 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.137894 Sep 15 09:03:43.042469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 499/951] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:42 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:43.399878 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-572f35ac-6623-4c0d-a682-37b9cc3c12f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:43.400876 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-572f35ac-6623-4c0d-a682-37b9cc3c12f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:43.408615 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-572f35ac-6623-4c0d-a682-37b9cc3c12f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:43.409065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-572f35ac-6623-4c0d-a682-37b9cc3c12f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:43.409840 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-572f35ac-6623-4c0d-a682-37b9cc3c12f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:43.410302 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-572f35ac-6623-4c0d-a682-37b9cc3c12f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:43.542930 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-572f35ac-6623-4c0d-a682-37b9cc3c12f8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 33433 microversion: 2.20 time: 0.152445 Sep 15 09:03:43.543742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 453/952] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:43 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 33433 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:44.058400 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-560dc36e-bf61-4eb3-b11f-4fb9dd48d00d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:44.059396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-560dc36e-bf61-4eb3-b11f-4fb9dd48d00d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:44.067247 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-560dc36e-bf61-4eb3-b11f-4fb9dd48d00d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:44.067696 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-560dc36e-bf61-4eb3-b11f-4fb9dd48d00d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:44.068456 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-560dc36e-bf61-4eb3-b11f-4fb9dd48d00d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:44.068884 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-560dc36e-bf61-4eb3-b11f-4fb9dd48d00d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:44.197520 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-560dc36e-bf61-4eb3-b11f-4fb9dd48d00d tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.148529 Sep 15 09:03:44.198167 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 500/953] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:44 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 09:03:44.561478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-345f95b0-23de-423b-af6e-81aa6cd0506c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:44.562483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-345f95b0-23de-423b-af6e-81aa6cd0506c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:44.570266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-345f95b0-23de-423b-af6e-81aa6cd0506c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:44.570704 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-345f95b0-23de-423b-af6e-81aa6cd0506c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:44.571459 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-345f95b0-23de-423b-af6e-81aa6cd0506c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:44.571883 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-345f95b0-23de-423b-af6e-81aa6cd0506c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:44.704673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-345f95b0-23de-423b-af6e-81aa6cd0506c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 34805 microversion: 2.20 time: 0.153159 Sep 15 09:03:44.705283 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 454/954] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:44 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 34805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:45.214327 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cc2e865a-0087-4740-8ae0-42b7f2f976c3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:45.215328 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cc2e865a-0087-4740-8ae0-42b7f2f976c3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:45.223072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc2e865a-0087-4740-8ae0-42b7f2f976c3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:45.223518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc2e865a-0087-4740-8ae0-42b7f2f976c3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:45.224276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc2e865a-0087-4740-8ae0-42b7f2f976c3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:45.224704 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cc2e865a-0087-4740-8ae0-42b7f2f976c3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:45.359651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cc2e865a-0087-4740-8ae0-42b7f2f976c3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.154773 Sep 15 09:03:45.360310 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 501/955] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:45 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 09:03:45.728615 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a16e366e-8d5f-482c-930c-530010b6e044 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:45.729600 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a16e366e-8d5f-482c-930c-530010b6e044 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:45.737983 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a16e366e-8d5f-482c-930c-530010b6e044 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:45.738456 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a16e366e-8d5f-482c-930c-530010b6e044 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:45.739208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a16e366e-8d5f-482c-930c-530010b6e044 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:45.739633 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a16e366e-8d5f-482c-930c-530010b6e044 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:45.870111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a16e366e-8d5f-482c-930c-530010b6e044 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 36092 microversion: 2.20 time: 0.150899 Sep 15 09:03:45.870710 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 455/956] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:45 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 36092 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:46.377318 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d7bdffb1-a60c-486a-93a6-aef3ea7b2deb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:46.378766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d7bdffb1-a60c-486a-93a6-aef3ea7b2deb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:46.388491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7bdffb1-a60c-486a-93a6-aef3ea7b2deb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:46.388940 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7bdffb1-a60c-486a-93a6-aef3ea7b2deb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:46.389713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7bdffb1-a60c-486a-93a6-aef3ea7b2deb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:46.390159 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d7bdffb1-a60c-486a-93a6-aef3ea7b2deb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:46.514630 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d7bdffb1-a60c-486a-93a6-aef3ea7b2deb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 14 microversion: 2.1 time: 0.146884 Sep 15 09:03:46.514630 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 502/957] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:46 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:03:46.888062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-10da108a-cf3f-4cf2-be6f-e312e37ade41 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:46.891679 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-10da108a-cf3f-4cf2-be6f-e312e37ade41 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:46.896710 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10da108a-cf3f-4cf2-be6f-e312e37ade41 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:46.897142 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10da108a-cf3f-4cf2-be6f-e312e37ade41 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:46.897889 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10da108a-cf3f-4cf2-be6f-e312e37ade41 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:46.898341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-10da108a-cf3f-4cf2-be6f-e312e37ade41 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:47.030959 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-10da108a-cf3f-4cf2-be6f-e312e37ade41 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 37719 microversion: 2.20 time: 0.152382 Sep 15 09:03:47.031584 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 456/958] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:46 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 37719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:47.530764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-53e470b7-885e-4577-9ef5-4071bebb83b8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:47.531692 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-53e470b7-885e-4577-9ef5-4071bebb83b8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:47.539559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53e470b7-885e-4577-9ef5-4071bebb83b8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:47.540000 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53e470b7-885e-4577-9ef5-4071bebb83b8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:47.540772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53e470b7-885e-4577-9ef5-4071bebb83b8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:47.541201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-53e470b7-885e-4577-9ef5-4071bebb83b8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:47.674438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-53e470b7-885e-4577-9ef5-4071bebb83b8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 10235 microversion: 2.1 time: 0.153198 Sep 15 09:03:47.675052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 503/959] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:47 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 10235 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:03:48.049214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0dde3524-1b8b-4afc-8fde-9dcf1946c9c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:48.050225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0dde3524-1b8b-4afc-8fde-9dcf1946c9c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:48.062883 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dde3524-1b8b-4afc-8fde-9dcf1946c9c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:48.063318 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dde3524-1b8b-4afc-8fde-9dcf1946c9c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:48.064087 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dde3524-1b8b-4afc-8fde-9dcf1946c9c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:48.064508 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dde3524-1b8b-4afc-8fde-9dcf1946c9c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:48.201886 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0dde3524-1b8b-4afc-8fde-9dcf1946c9c0 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 38234 microversion: 2.20 time: 0.162509 Sep 15 09:03:48.202627 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 457/960] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:48 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 38234 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:48.692194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8ba66ece-0fb2-4be6-baf3-36fc239f9df4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:48.693187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8ba66ece-0fb2-4be6-baf3-36fc239f9df4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:48.701600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ba66ece-0fb2-4be6-baf3-36fc239f9df4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:48.702038 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ba66ece-0fb2-4be6-baf3-36fc239f9df4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:48.702826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ba66ece-0fb2-4be6-baf3-36fc239f9df4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:48.703255 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8ba66ece-0fb2-4be6-baf3-36fc239f9df4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:48.836362 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8ba66ece-0fb2-4be6-baf3-36fc239f9df4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 17459 microversion: 2.1 time: 0.154144 Sep 15 09:03:48.836953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 504/961] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:48 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 17459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:49.218874 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e8ff9c30-d976-4b08-82e3-2b804f09ef3e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:49.219859 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e8ff9c30-d976-4b08-82e3-2b804f09ef3e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:49.227575 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8ff9c30-d976-4b08-82e3-2b804f09ef3e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:49.228012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8ff9c30-d976-4b08-82e3-2b804f09ef3e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:49.228768 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8ff9c30-d976-4b08-82e3-2b804f09ef3e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:49.229197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8ff9c30-d976-4b08-82e3-2b804f09ef3e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:49.364324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e8ff9c30-d976-4b08-82e3-2b804f09ef3e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 38234 microversion: 2.20 time: 0.154762 Sep 15 09:03:49.364924 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 458/962] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:49 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 38234 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:03:49.853317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c3cfb0df-4dc4-4955-8d1f-891eb169b80a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:49.854336 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c3cfb0df-4dc4-4955-8d1f-891eb169b80a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:49.862021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c3cfb0df-4dc4-4955-8d1f-891eb169b80a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:49.862493 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c3cfb0df-4dc4-4955-8d1f-891eb169b80a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:49.863252 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c3cfb0df-4dc4-4955-8d1f-891eb169b80a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:49.863680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c3cfb0df-4dc4-4955-8d1f-891eb169b80a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:50.001359 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c3cfb0df-4dc4-4955-8d1f-891eb169b80a tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 18871 microversion: 2.1 time: 0.157423 Sep 15 09:03:50.002210 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 505/963] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:49 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 18871 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:50.382722 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2964e78a-4693-440c-bc2d-e4effac596b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:50.383700 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2964e78a-4693-440c-bc2d-e4effac596b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:50.391391 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2964e78a-4693-440c-bc2d-e4effac596b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:50.391821 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2964e78a-4693-440c-bc2d-e4effac596b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:50.392562 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2964e78a-4693-440c-bc2d-e4effac596b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:50.392981 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2964e78a-4693-440c-bc2d-e4effac596b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:50.521585 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2964e78a-4693-440c-bc2d-e4effac596b8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 38234 microversion: 2.20 time: 0.148008 Sep 15 09:03:50.522160 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 459/964] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:50 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 38234 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 09:03:51.018769 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-26b14c1c-693e-4075-9081-d3c0ab5e9194 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:51.019787 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-26b14c1c-693e-4075-9081-d3c0ab5e9194 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:51.027527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26b14c1c-693e-4075-9081-d3c0ab5e9194 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:51.027977 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26b14c1c-693e-4075-9081-d3c0ab5e9194 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:51.028746 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26b14c1c-693e-4075-9081-d3c0ab5e9194 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:51.029184 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26b14c1c-693e-4075-9081-d3c0ab5e9194 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:51.159381 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-26b14c1c-693e-4075-9081-d3c0ab5e9194 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 21344 microversion: 2.1 time: 0.150089 Sep 15 09:03:51.161085 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 506/965] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:51 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 21344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:51.539258 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-da4cb69c-d1a2-45c6-ba4b-b005ad193360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:51.540243 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-da4cb69c-d1a2-45c6-ba4b-b005ad193360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:51.548061 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da4cb69c-d1a2-45c6-ba4b-b005ad193360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:51.550010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da4cb69c-d1a2-45c6-ba4b-b005ad193360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:51.550010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da4cb69c-d1a2-45c6-ba4b-b005ad193360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:51.550010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-da4cb69c-d1a2-45c6-ba4b-b005ad193360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:51.680320 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-da4cb69c-d1a2-45c6-ba4b-b005ad193360 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 200 len: 38375 microversion: 2.20 time: 0.150476 Sep 15 09:03:51.680932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 460/966] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:51 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 38375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 09:03:51.697480 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2b835d51-a9f5-4ec1-a473-f197275c1e33 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:51.698058 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2b835d51-a9f5-4ec1-a473-f197275c1e33 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:51.706579 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b835d51-a9f5-4ec1-a473-f197275c1e33 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:51.707051 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b835d51-a9f5-4ec1-a473-f197275c1e33 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:51.707824 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b835d51-a9f5-4ec1-a473-f197275c1e33 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:51.708258 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b835d51-a9f5-4ec1-a473-f197275c1e33 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:51.769046 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2b835d51-a9f5-4ec1-a473-f197275c1e33 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/ips" status: 200 len: 151 microversion: 2.20 time: 0.081452 Sep 15 09:03:51.769601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 507/967] 10.222.0.39 () {60 vars in 1289 bytes} [Wed Sep 15 09:03:51 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/ips => generated 151 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:52.176442 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e3bef7c6-2b0f-4f18-92ea-be14522ecded tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:52.177428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e3bef7c6-2b0f-4f18-92ea-be14522ecded tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:52.185400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e3bef7c6-2b0f-4f18-92ea-be14522ecded tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:52.186474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e3bef7c6-2b0f-4f18-92ea-be14522ecded tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:52.187260 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e3bef7c6-2b0f-4f18-92ea-be14522ecded tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:52.187687 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e3bef7c6-2b0f-4f18-92ea-be14522ecded tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:52.315712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e3bef7c6-2b0f-4f18-92ea-be14522ecded tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 23235 microversion: 2.1 time: 0.149153 Sep 15 09:03:52.316477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 461/968] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:52 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 23235 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:03:53.332800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-34ed6e47-aff0-4203-94e4-9f5a63816b91 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:53.333713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-34ed6e47-aff0-4203-94e4-9f5a63816b91 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:53.341246 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ed6e47-aff0-4203-94e4-9f5a63816b91 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:53.341690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ed6e47-aff0-4203-94e4-9f5a63816b91 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:53.342488 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ed6e47-aff0-4203-94e4-9f5a63816b91 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:53.342922 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ed6e47-aff0-4203-94e4-9f5a63816b91 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:53.474613 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-34ed6e47-aff0-4203-94e4-9f5a63816b91 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 24792 microversion: 2.1 time: 0.150743 Sep 15 09:03:53.475142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 508/969] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:53 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 24792 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:54.291781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:54.292388 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:54.300122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:54.300563 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:54.301310 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:54.301731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:54.361083 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lazy-loading 'flavor' on Instance uuid eea6d38f-dd74-452c-b2ad-51db3fe58d6e {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:03:54.492332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f01cea19-ed94-448e-9fc1-1ebdc4564564 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:54.493254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f01cea19-ed94-448e-9fc1-1ebdc4564564 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:54.501609 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f01cea19-ed94-448e-9fc1-1ebdc4564564 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:54.502056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f01cea19-ed94-448e-9fc1-1ebdc4564564 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:54.503029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f01cea19-ed94-448e-9fc1-1ebdc4564564 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:54.503466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f01cea19-ed94-448e-9fc1-1ebdc4564564 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:54.633469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f01cea19-ed94-448e-9fc1-1ebdc4564564 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 26445 microversion: 2.1 time: 0.150820 Sep 15 09:03:54.634108 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 509/970] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:54 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 26445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:03:54.947085 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0b0aca86-cf18-458d-8f67-2c7269f526f7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 202 len: 0 microversion: 2.20 time: 0.664727 Sep 15 09:03:54.950116 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 462/971] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:03:54 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:03:54.962522 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:54.963302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:54.971201 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:54.971640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:54.972397 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:54.972864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:55.174014 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:55.187812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:55.194005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:55.195133 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ed12291b-f3e8-4bc9-af01-7503b9d51432 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.243209 Sep 15 09:03:55.195654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 510/972] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:54 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:55.651063 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-18462745-9a09-4fee-a945-fa9c776d6509 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:55.652075 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-18462745-9a09-4fee-a945-fa9c776d6509 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:55.660111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18462745-9a09-4fee-a945-fa9c776d6509 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:55.660551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18462745-9a09-4fee-a945-fa9c776d6509 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:55.661306 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18462745-9a09-4fee-a945-fa9c776d6509 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:55.661731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18462745-9a09-4fee-a945-fa9c776d6509 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:55.800007 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-18462745-9a09-4fee-a945-fa9c776d6509 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 27503 microversion: 2.1 time: 0.158876 Sep 15 09:03:55.803820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 463/973] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:55 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 27503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:56.218565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:56.219169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:56.230450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:56.230898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:56.231655 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:56.232084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:56.429750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:56.443527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:56.449665 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:56.450782 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f366daba-1462-4763-9c3f-50bb00392576 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.241568 Sep 15 09:03:56.451298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 511/974] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:56 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:56.817635 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ca7b494e-4d6f-49eb-8832-068bf70580e8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:56.818646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ca7b494e-4d6f-49eb-8832-068bf70580e8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:56.826378 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca7b494e-4d6f-49eb-8832-068bf70580e8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:56.826813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca7b494e-4d6f-49eb-8832-068bf70580e8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:56.827565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca7b494e-4d6f-49eb-8832-068bf70580e8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:56.827992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ca7b494e-4d6f-49eb-8832-068bf70580e8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:56.968224 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ca7b494e-4d6f-49eb-8832-068bf70580e8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28054 microversion: 2.1 time: 0.159942 Sep 15 09:03:56.968840 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 464/975] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:56 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28054 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:57.473926 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:57.474486 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:57.481639 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:57.482099 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:57.482871 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:57.483297 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:57.679961 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:57.693488 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:57.699645 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:57.700715 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f5579849-0d86-4d89-9db1-05596395cdec tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.235958 Sep 15 09:03:57.701840 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 512/976] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:57 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:57.987035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ac1ce3b0-5561-45e3-be9c-b7a1aa028eb3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:57.988021 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ac1ce3b0-5561-45e3-be9c-b7a1aa028eb3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:57.996138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac1ce3b0-5561-45e3-be9c-b7a1aa028eb3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:57.996574 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac1ce3b0-5561-45e3-be9c-b7a1aa028eb3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:57.997317 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac1ce3b0-5561-45e3-be9c-b7a1aa028eb3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:57.997741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ac1ce3b0-5561-45e3-be9c-b7a1aa028eb3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:58.126345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ac1ce3b0-5561-45e3-be9c-b7a1aa028eb3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28241 microversion: 2.1 time: 0.149247 Sep 15 09:03:58.130252 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 465/977] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:57 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:58.724984 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:58.725580 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:58.733074 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:58.733508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:58.734283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:58.734705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:58.946821 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:58.960382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:58.966499 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:03:58.967571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a3254511-003b-4270-b140-d1762c90ea85 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.252330 Sep 15 09:03:58.968092 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 513/978] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:58 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:03:59.144548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1b5c9fa5-b231-4113-b140-afe7db219df3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:03:59.145542 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1b5c9fa5-b231-4113-b140-afe7db219df3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:59.153378 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b5c9fa5-b231-4113-b140-afe7db219df3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:59.153828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b5c9fa5-b231-4113-b140-afe7db219df3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:59.154608 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b5c9fa5-b231-4113-b140-afe7db219df3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:59.155051 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1b5c9fa5-b231-4113-b140-afe7db219df3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:03:59.274268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1b5c9fa5-b231-4113-b140-afe7db219df3 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28241 microversion: 2.1 time: 0.139711 Sep 15 09:03:59.274879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 466/979] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:03:59 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:03:59.990468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:03:59.991067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:03:59.998615 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:03:59.999548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:00.000304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:00.000733 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:00.292157 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-337bc881-47b5-4018-8cfd-ee42e77e9920 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:00.293157 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-337bc881-47b5-4018-8cfd-ee42e77e9920 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:00.301597 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-337bc881-47b5-4018-8cfd-ee42e77e9920 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:00.302044 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-337bc881-47b5-4018-8cfd-ee42e77e9920 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:00.302845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-337bc881-47b5-4018-8cfd-ee42e77e9920 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:00.303274 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-337bc881-47b5-4018-8cfd-ee42e77e9920 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:00.336302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:00.349445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:00.355595 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:00.356685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-98e11df6-7135-4ce7-b2b5-48812bffc713 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.375352 Sep 15 09:04:00.357196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 514/980] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:03:59 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:00.433076 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-337bc881-47b5-4018-8cfd-ee42e77e9920 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28530 microversion: 2.1 time: 0.150397 Sep 15 09:04:00.433680 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 467/981] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:00 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28530 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:04:01.381114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:01.381741 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:01.388853 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:01.389946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:01.390759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:01.391188 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:01.450641 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d5f8af31-e35d-43ac-a286-c4b3e5d103e1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:01.451556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d5f8af31-e35d-43ac-a286-c4b3e5d103e1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:01.459845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d5f8af31-e35d-43ac-a286-c4b3e5d103e1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:01.460284 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d5f8af31-e35d-43ac-a286-c4b3e5d103e1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:01.461043 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d5f8af31-e35d-43ac-a286-c4b3e5d103e1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:01.461465 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d5f8af31-e35d-43ac-a286-c4b3e5d103e1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:01.592127 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:01.593545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d5f8af31-e35d-43ac-a286-c4b3e5d103e1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28700 microversion: 2.1 time: 0.152402 Sep 15 09:04:01.595095 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 468/982] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:01 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:04:01.605428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:01.612114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:01.613195 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9147601a-1088-4d54-bff7-4ef4e7d03932 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.241799 Sep 15 09:04:01.613688 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 515/983] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:01 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:02.611281 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-01e8b7df-124c-4cc1-a0fb-72b63af7bda4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:02.612284 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-01e8b7df-124c-4cc1-a0fb-72b63af7bda4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:02.620436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-01e8b7df-124c-4cc1-a0fb-72b63af7bda4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:02.620911 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-01e8b7df-124c-4cc1-a0fb-72b63af7bda4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:02.621681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-01e8b7df-124c-4cc1-a0fb-72b63af7bda4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:02.622135 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-01e8b7df-124c-4cc1-a0fb-72b63af7bda4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:02.636267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:02.636871 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:02.644555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:02.644997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:02.645756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:02.646219 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:02.762672 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-01e8b7df-124c-4cc1-a0fb-72b63af7bda4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28700 microversion: 2.1 time: 0.160640 Sep 15 09:04:02.767208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 469/984] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:02 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:02.849299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:02.862655 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:02.868969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:02.870031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dfeaac1c-779c-46ad-b119-8e11397442ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.242889 Sep 15 09:04:02.870563 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 516/985] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:02 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:03.780513 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-76aebfe8-6bcf-40e0-a79f-e66a4849ecf1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:03.781499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-76aebfe8-6bcf-40e0-a79f-e66a4849ecf1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:03.789296 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76aebfe8-6bcf-40e0-a79f-e66a4849ecf1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:03.789731 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76aebfe8-6bcf-40e0-a79f-e66a4849ecf1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:03.790504 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76aebfe8-6bcf-40e0-a79f-e66a4849ecf1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:03.790928 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-76aebfe8-6bcf-40e0-a79f-e66a4849ecf1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:03.894031 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:03.894655 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:03.901755 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:03.902232 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:03.902993 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:03.903423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:03.912490 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-76aebfe8-6bcf-40e0-a79f-e66a4849ecf1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28700 microversion: 2.1 time: 0.141918 Sep 15 09:04:03.916437 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 470/986] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:03 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28700 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:04.103650 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:04.117170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:04.123401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:04.124515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e74aa1ea-76ff-43f7-9bc8-fb93f9ff9921 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.240071 Sep 15 09:04:04.125012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 517/987] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:03 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:04.930944 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-343b07be-1abe-418f-adc9-6032bba55859 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:04.931965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-343b07be-1abe-418f-adc9-6032bba55859 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:04.939754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-343b07be-1abe-418f-adc9-6032bba55859 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:04.944673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-343b07be-1abe-418f-adc9-6032bba55859 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:04.944673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-343b07be-1abe-418f-adc9-6032bba55859 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:04.944673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-343b07be-1abe-418f-adc9-6032bba55859 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:05.065188 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-343b07be-1abe-418f-adc9-6032bba55859 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 28700 microversion: 2.1 time: 0.144467 Sep 15 09:04:05.065796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 471/988] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:04 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 28700 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:05.148005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:05.148605 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:05.156302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:05.156736 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:05.157492 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:05.157911 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:05.367426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:05.373666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:05.379998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:05.381091 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a13e03d8-4ef6-42ac-bfe8-f0a81216f6bf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.242426 Sep 15 09:04:05.381598 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 518/989] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:05 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:06.082816 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7ce54f21-d122-4e65-bacf-a58d10608ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:06.083808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7ce54f21-d122-4e65-bacf-a58d10608ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:06.091599 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ce54f21-d122-4e65-bacf-a58d10608ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:06.092045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ce54f21-d122-4e65-bacf-a58d10608ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:06.092880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ce54f21-d122-4e65-bacf-a58d10608ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:06.093307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ce54f21-d122-4e65-bacf-a58d10608ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:06.235178 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7ce54f21-d122-4e65-bacf-a58d10608ada tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 30388 microversion: 2.1 time: 0.161708 Sep 15 09:04:06.235725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 472/990] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:06 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 30388 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:06.405568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:06.406197 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:06.413310 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:06.413751 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:06.414544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:06.414975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:06.617836 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:06.631170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:06.637322 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:06.638435 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ec507495-3106-477f-80c4-debceec7ddb5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1743 microversion: 2.20 time: 0.242634 Sep 15 09:04:06.638944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 519/991] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:06 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:07.252402 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-059d92ea-a5da-40b0-80f3-903ff909e7a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:07.253386 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-059d92ea-a5da-40b0-80f3-903ff909e7a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:07.261155 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-059d92ea-a5da-40b0-80f3-903ff909e7a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:07.261595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-059d92ea-a5da-40b0-80f3-903ff909e7a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:07.262380 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-059d92ea-a5da-40b0-80f3-903ff909e7a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:07.262809 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-059d92ea-a5da-40b0-80f3-903ff909e7a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:07.426639 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-059d92ea-a5da-40b0-80f3-903ff909e7a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 31714 microversion: 2.1 time: 0.183885 Sep 15 09:04:07.427192 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 473/992] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:07 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 31714 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:07.661881 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:07.662494 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:07.669559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:07.670000 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:07.671291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:07.671713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:07.880096 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:07.893920 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:07.900239 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:07.903926 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c70c1978-1d53-42a1-97d8-88e771ccdb08 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1743 microversion: 2.20 time: 0.248587 Sep 15 09:04:07.903926 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 520/993] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:07 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:08.444138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9a5dc27c-fbf2-4855-8aa9-8fab521073a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:08.445712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9a5dc27c-fbf2-4855-8aa9-8fab521073a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:08.453922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9a5dc27c-fbf2-4855-8aa9-8fab521073a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:08.454401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9a5dc27c-fbf2-4855-8aa9-8fab521073a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:08.455159 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9a5dc27c-fbf2-4855-8aa9-8fab521073a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:08.455580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9a5dc27c-fbf2-4855-8aa9-8fab521073a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:08.590037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9a5dc27c-fbf2-4855-8aa9-8fab521073a1 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 33330 microversion: 2.1 time: 0.155175 Sep 15 09:04:08.591133 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 474/994] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:08 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 33330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:08.925039 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:08.926414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:08.933757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:08.934281 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:08.935223 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:08.936346 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:09.172390 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:09.200963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:09.208426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:09.209588 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-26014b4b-2ccd-4137-8783-5f51862e163e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.293858 Sep 15 09:04:09.210509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 521/995] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:08 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:09.608958 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bf89b556-f9ec-45c7-872e-b65674a90f4c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:09.610712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bf89b556-f9ec-45c7-872e-b65674a90f4c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:09.618795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf89b556-f9ec-45c7-872e-b65674a90f4c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:09.620417 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf89b556-f9ec-45c7-872e-b65674a90f4c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:09.620417 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf89b556-f9ec-45c7-872e-b65674a90f4c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:09.620987 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bf89b556-f9ec-45c7-872e-b65674a90f4c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:09.757623 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bf89b556-f9ec-45c7-872e-b65674a90f4c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 34227 microversion: 2.1 time: 0.158249 Sep 15 09:04:09.759595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 475/996] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:09 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 34227 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:10.234864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:10.235601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:10.243596 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:10.244073 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:10.244803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:10.245225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:10.469078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:10.485523 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:10.492491 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:10.493825 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-61f77ac8-b886-4fde-877d-da6b723ed5c8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.269247 Sep 15 09:04:10.494874 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 522/997] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:10 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:10.727430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-6d85c8c6-df7c-4b91-a663-d0984023b9d0 req-8c76f431-7d19-42a1-84ec-d211127a55f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea6d38f-dd74-452c-b2ad-51db3fe58d6e", "name": "network-vif-plugged", "status": "completed", "tag": "e9ff7f1c-60ef-492f-a949-c6144ac7bdcb"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:10.734938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:04:10.734938 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:04:10.748406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-6d85c8c6-df7c-4b91-a663-d0984023b9d0 req-8c76f431-7d19-42a1-84ec-d211127a55f8 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:10.749127 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-6d85c8c6-df7c-4b91-a663-d0984023b9d0 req-8c76f431-7d19-42a1-84ec-d211127a55f8 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:10.771734 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-6d85c8c6-df7c-4b91-a663-d0984023b9d0 req-8c76f431-7d19-42a1-84ec-d211127a55f8 service nova] Creating event network-vif-plugged:e9ff7f1c-60ef-492f-a949-c6144ac7bdcb for instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e on hv-cinder-80600 Sep 15 09:04:10.776849 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-6d85c8c6-df7c-4b91-a663-d0984023b9d0 req-8c76f431-7d19-42a1-84ec-d211127a55f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063510 Sep 15 09:04:10.777515 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 476/998] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:04:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:04:10.785719 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-44d24228-7ead-43ca-8fff-5a5bf5003e02 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:10.786785 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-44d24228-7ead-43ca-8fff-5a5bf5003e02 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:10.797651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44d24228-7ead-43ca-8fff-5a5bf5003e02 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:10.798373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44d24228-7ead-43ca-8fff-5a5bf5003e02 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:10.805838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44d24228-7ead-43ca-8fff-5a5bf5003e02 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:10.805838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44d24228-7ead-43ca-8fff-5a5bf5003e02 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:10.941670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-44d24228-7ead-43ca-8fff-5a5bf5003e02 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 35281 microversion: 2.1 time: 0.174623 Sep 15 09:04:10.942219 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 523/999] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:10 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 35281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:04:11.520655 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:11.521500 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:11.531548 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:11.532025 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:11.532858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:11.533433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:11.750186 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:11.763369 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:11.770181 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:11.771268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6869fe17-744d-4763-9dcd-da953ce243a8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.261951 Sep 15 09:04:11.771724 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 477/1000] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:11 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:11.962706 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5ba99d29-f911-43d6-81e4-0501ba719948 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:11.963720 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5ba99d29-f911-43d6-81e4-0501ba719948 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:11.973650 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5ba99d29-f911-43d6-81e4-0501ba719948 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:11.974602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5ba99d29-f911-43d6-81e4-0501ba719948 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:11.975486 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5ba99d29-f911-43d6-81e4-0501ba719948 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:11.975917 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5ba99d29-f911-43d6-81e4-0501ba719948 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:12.128869 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5ba99d29-f911-43d6-81e4-0501ba719948 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 36686 microversion: 2.1 time: 0.178937 Sep 15 09:04:12.130117 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 524/1001] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:11 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 36686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:12.794858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:12.796683 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:12.804574 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:12.805017 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:12.805957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:12.806559 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:13.026332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:13.041438 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:13.048210 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:13.049857 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c4874c15-3209-4b46-a336-088fac1bbaf9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.264847 Sep 15 09:04:13.050944 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 478/1002] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:12 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:13.151683 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-026a6a3f-ba6d-4515-98b3-4f155120ea8c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:13.153436 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-026a6a3f-ba6d-4515-98b3-4f155120ea8c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:13.162861 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-026a6a3f-ba6d-4515-98b3-4f155120ea8c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:13.163581 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-026a6a3f-ba6d-4515-98b3-4f155120ea8c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:13.164378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-026a6a3f-ba6d-4515-98b3-4f155120ea8c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:13.164801 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-026a6a3f-ba6d-4515-98b3-4f155120ea8c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:13.307503 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-026a6a3f-ba6d-4515-98b3-4f155120ea8c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 38072 microversion: 2.1 time: 0.169953 Sep 15 09:04:13.308123 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 525/1003] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:13 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 38072 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:14.074030 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:14.075320 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:14.087644 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:14.091429 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:14.091860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:14.092365 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:14.317018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:14.325320 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-322b3f4b-1fc0-455f-9382-5f00e878502b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:14.326852 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-322b3f4b-1fc0-455f-9382-5f00e878502b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:14.331124 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:14.334696 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-322b3f4b-1fc0-455f-9382-5f00e878502b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:14.335305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-322b3f4b-1fc0-455f-9382-5f00e878502b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:14.336337 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-322b3f4b-1fc0-455f-9382-5f00e878502b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:14.336692 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-322b3f4b-1fc0-455f-9382-5f00e878502b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:14.340357 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:14.341518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f582a405-f27c-4557-b291-9001267a875c tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.276799 Sep 15 09:04:14.342623 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 479/1004] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:14 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:14.485317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-322b3f4b-1fc0-455f-9382-5f00e878502b tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 38231 microversion: 2.1 time: 0.169707 Sep 15 09:04:14.486298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 526/1005] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:14 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 38231 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:04:15.364526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:15.365906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:15.373929 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:15.374470 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:15.375309 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:15.375965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:15.505689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-df1a509c-f1a7-45d4-8553-4978510e8e44 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:15.506656 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-df1a509c-f1a7-45d4-8553-4978510e8e44 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:15.515677 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df1a509c-f1a7-45d4-8553-4978510e8e44 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:15.516113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df1a509c-f1a7-45d4-8553-4978510e8e44 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:15.516953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df1a509c-f1a7-45d4-8553-4978510e8e44 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:15.517379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-df1a509c-f1a7-45d4-8553-4978510e8e44 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:15.598616 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:15.613412 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:15.620193 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:15.621676 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9ea9a122-849b-4553-ae81-0df46856dafc tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.266088 Sep 15 09:04:15.627234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 480/1006] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:15 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:15.656309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-df1a509c-f1a7-45d4-8553-4978510e8e44 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 38231 microversion: 2.1 time: 0.161914 Sep 15 09:04:15.657200 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 527/1007] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:15 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 38231 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:04:16.647503 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:16.648093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:16.655901 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:16.656429 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:16.657197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:16.657637 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:16.678285 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f6dd1292-4be0-4648-bd70-5a7122383392 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:16.680035 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f6dd1292-4be0-4648-bd70-5a7122383392 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:16.692005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f6dd1292-4be0-4648-bd70-5a7122383392 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:16.692823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f6dd1292-4be0-4648-bd70-5a7122383392 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:16.693837 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f6dd1292-4be0-4648-bd70-5a7122383392 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:16.694612 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f6dd1292-4be0-4648-bd70-5a7122383392 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:16.832575 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f6dd1292-4be0-4648-bd70-5a7122383392 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 38231 microversion: 2.1 time: 0.167657 Sep 15 09:04:16.833846 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 528/1008] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:16 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 38231 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:04:16.892519 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:16.909675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:16.916325 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:16.917544 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2fb6cf1d-0981-4102-bc41-453216302411 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.281449 Sep 15 09:04:16.922239 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 481/1009] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:16 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:17.851292 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-05b9b24a-853f-48f8-bb7b-273ae1805c23 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:17.852305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-05b9b24a-853f-48f8-bb7b-273ae1805c23 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:17.860550 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05b9b24a-853f-48f8-bb7b-273ae1805c23 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:17.860988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05b9b24a-853f-48f8-bb7b-273ae1805c23 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:17.861772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05b9b24a-853f-48f8-bb7b-273ae1805c23 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:17.862230 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-05b9b24a-853f-48f8-bb7b-273ae1805c23 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:17.942332 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:17.943018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:17.950516 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:17.950954 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:17.952351 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:17.952789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:18.012724 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-05b9b24a-853f-48f8-bb7b-273ae1805c23 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action" status: 200 len: 38360 microversion: 2.1 time: 0.171114 Sep 15 09:04:18.014196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 529/1010] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:04:17 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/action => generated 38360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 09:04:18.030717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1d67700d-3b74-48da-964c-80c57a8d51da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:18.031047 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1d67700d-3b74-48da-964c-80c57a8d51da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:18.039272 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d67700d-3b74-48da-964c-80c57a8d51da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:18.039719 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d67700d-3b74-48da-964c-80c57a8d51da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:18.040526 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d67700d-3b74-48da-964c-80c57a8d51da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:18.040959 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d67700d-3b74-48da-964c-80c57a8d51da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:18.106784 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1d67700d-3b74-48da-964c-80c57a8d51da tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/ips" status: 200 len: 146 microversion: 2.1 time: 0.086199 Sep 15 09:04:18.108089 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 530/1011] 10.222.0.39 () {58 vars in 1248 bytes} [Wed Sep 15 09:04:18 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:04:18.174161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:18.188266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:18.194577 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:18.195757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-a6ed1fb4-eca6-4cf2-a790-77b150ffa313 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.263301 Sep 15 09:04:18.196278 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 482/1012] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:17 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:19.220016 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:19.221254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:19.228986 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:19.229618 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:19.230423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:19.230855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:19.445352 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:19.458586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:19.464748 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:19.465832 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-3b79ceca-19d3-4c2a-8bf1-b6148ad1d557 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1738 microversion: 2.20 time: 0.255849 Sep 15 09:04:19.466382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 531/1013] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:19 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:20.151856 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b45bad48-d86d-4045-af12-50409523b10e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6034daca-601a-4b9e-8586-da3bbd17ad03"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:20.152958 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b45bad48-d86d-4045-af12-50409523b10e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:20.161319 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b45bad48-d86d-4045-af12-50409523b10e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:20.161319 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b45bad48-d86d-4045-af12-50409523b10e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:20.162013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b45bad48-d86d-4045-af12-50409523b10e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:20.162465 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b45bad48-d86d-4045-af12-50409523b10e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:20.489953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:20.490578 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:20.498555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:20.499004 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:20.499767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:20.500231 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:20.711514 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:20.725641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:20.731870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:20.733559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f3c3b263-8a14-44e3-8a06-13a529949111 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1720 microversion: 2.20 time: 0.253285 Sep 15 09:04:20.734077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 532/1014] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:20 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:20.978722 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b45bad48-d86d-4045-af12-50409523b10e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835811 Sep 15 09:04:20.983245 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 483/1015] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:04:20 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:04:21.758214 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:21.758756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:21.766894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:21.767331 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:21.768157 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:21.768576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:21.976377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:21.991028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:21.998403 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:21.999660 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bf2e62ab-d230-45c0-ad29-fac8ed4d5158 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1720 microversion: 2.20 time: 0.250894 Sep 15 09:04:22.000179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 533/1016] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:21 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1720 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:23.024808 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:23.025499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:23.033612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:23.034055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:23.034852 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:23.035290 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:23.241154 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:23.255379 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:23.261640 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:23.262946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bc2e44c4-57a8-493f-bf92-f7171a1c41f4 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1720 microversion: 2.20 time: 0.248281 Sep 15 09:04:23.266785 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 484/1017] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:23 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:24.286406 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:24.287010 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:24.294386 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:24.294831 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:24.295597 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:24.296027 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:24.493631 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:24.507309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:24.514217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:24.519036 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-13b3f20b-8410-4443-b889-8bdc2b034ae5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1663 microversion: 2.20 time: 0.238702 Sep 15 09:04:24.519036 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 534/1018] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:24 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1663 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:24.539866 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-33dc65a8-bacd-40c3-b94b-488dc8986b37 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28055fa7-6d39-4a52-a2c2-a65ec773d8aa"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:24.540946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-33dc65a8-bacd-40c3-b94b-488dc8986b37 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:24.548141 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33dc65a8-bacd-40c3-b94b-488dc8986b37 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:24.548576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33dc65a8-bacd-40c3-b94b-488dc8986b37 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:24.549333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33dc65a8-bacd-40c3-b94b-488dc8986b37 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:24.549757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-33dc65a8-bacd-40c3-b94b-488dc8986b37 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:24.710831 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-106bfcd6-0c33-47a0-a6b0-412c2591339c req-dfe4118a-8c7e-425f-955f-311efd94b330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea6d38f-dd74-452c-b2ad-51db3fe58d6e", "name": "network-vif-unplugged", "status": "completed", "tag": "e9ff7f1c-60ef-492f-a949-c6144ac7bdcb"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:24.717130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:04:24.717130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:04:24.725263 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-106bfcd6-0c33-47a0-a6b0-412c2591339c req-dfe4118a-8c7e-425f-955f-311efd94b330 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:24.725712 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-106bfcd6-0c33-47a0-a6b0-412c2591339c req-dfe4118a-8c7e-425f-955f-311efd94b330 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:24.745111 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.compute.server_external_events [req-106bfcd6-0c33-47a0-a6b0-412c2591339c req-dfe4118a-8c7e-425f-955f-311efd94b330 service nova] Unable to find a host for instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e. Dropping event network-vif-unplugged {{(pid=89582) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 15 09:04:24.745986 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-106bfcd6-0c33-47a0-a6b0-412c2591339c req-dfe4118a-8c7e-425f-955f-311efd94b330 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045503 Sep 15 09:04:24.746673 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 535/1019] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:04:24 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 09:04:25.608002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-33dc65a8-bacd-40c3-b94b-488dc8986b37 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.077196 Sep 15 09:04:25.608606 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 485/1020] 10.222.0.39 () {62 vars in 1364 bytes} [Wed Sep 15 09:04:24 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-volume_attachments => generated 188 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 09:04:25.805285 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-52161691-3179-46ae-bbbc-3ce431d7c450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:25.805780 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-52161691-3179-46ae-bbbc-3ce431d7c450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:25.813388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52161691-3179-46ae-bbbc-3ce431d7c450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:25.813858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52161691-3179-46ae-bbbc-3ce431d7c450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:25.814689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52161691-3179-46ae-bbbc-3ce431d7c450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:25.815166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-52161691-3179-46ae-bbbc-3ce431d7c450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:26.708355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-52161691-3179-46ae-bbbc-3ce431d7c450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-volume_attachments/28055fa7-6d39-4a52-a2c2-a65ec773d8aa" status: 202 len: 0 microversion: 2.20 time: 0.912035 Sep 15 09:04:26.708921 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 536/1021] 10.222.0.39 () {60 vars in 1457 bytes} [Wed Sep 15 09:04:25 2021] DELETE /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-volume_attachments/28055fa7-6d39-4a52-a2c2-a65ec773d8aa => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:04:26.810450 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e8818402-87ad-409b-8a53-550d0d7c714d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:26.811009 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e8818402-87ad-409b-8a53-550d0d7c714d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:26.818708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8818402-87ad-409b-8a53-550d0d7c714d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:26.819146 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8818402-87ad-409b-8a53-550d0d7c714d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:26.819894 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8818402-87ad-409b-8a53-550d0d7c714d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:26.820316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8818402-87ad-409b-8a53-550d0d7c714d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:27.153493 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e8818402-87ad-409b-8a53-550d0d7c714d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action" status: 202 len: 0 microversion: 2.20 time: 0.352142 Sep 15 09:04:27.154847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 486/1022] 10.222.0.39 () {62 vars in 1319 bytes} [Wed Sep 15 09:04:26 2021] POST /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:04:27.168011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:27.168614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:27.175793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:27.176230 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:27.176988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:27.177412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:27.433300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:27.447190 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:27.454377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:27.455489 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c5384c99-4068-4dad-be54-0cd9dcc97450 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1671 microversion: 2.20 time: 0.296511 Sep 15 09:04:27.456007 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 537/1023] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:27 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1671 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:28.478776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:28.479995 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:28.487748 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:28.488191 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:28.489058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:28.489486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:28.849412 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f5135e9d-2933-45a2-921f-ea5ed74f564c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:28.850367 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f5135e9d-2933-45a2-921f-ea5ed74f564c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:28.858179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5135e9d-2933-45a2-921f-ea5ed74f564c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:28.858620 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5135e9d-2933-45a2-921f-ea5ed74f564c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:28.859766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5135e9d-2933-45a2-921f-ea5ed74f564c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:28.859894 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f5135e9d-2933-45a2-921f-ea5ed74f564c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:28.873635 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:28.887288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:28.894122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:28.895320 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bbde61b3-a927-4e7c-a1f5-dc429431ee76 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1673 microversion: 2.20 time: 0.426089 Sep 15 09:04:28.896266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 487/1024] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:28 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1673 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:28.931060 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f5135e9d-2933-45a2-921f-ea5ed74f564c tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091358 Sep 15 09:04:28.931598 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 538/1025] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:04:28 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:04:28.947067 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d8f9379a-a8ca-4b3a-ab99-364d942e0cc8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:28.947549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d8f9379a-a8ca-4b3a-ab99-364d942e0cc8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:28.955575 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8f9379a-a8ca-4b3a-ab99-364d942e0cc8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:28.955935 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8f9379a-a8ca-4b3a-ab99-364d942e0cc8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:28.956688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8f9379a-a8ca-4b3a-ab99-364d942e0cc8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:28.957118 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8f9379a-a8ca-4b3a-ab99-364d942e0cc8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:29.025474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d8f9379a-a8ca-4b3a-ab99-364d942e0cc8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/6034daca-601a-4b9e-8586-da3bbd17ad03" status: 200 len: 194 microversion: 2.1 time: 0.087600 Sep 15 09:04:29.026035 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 488/1026] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Sep 15 09:04:28 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/6034daca-601a-4b9e-8586-da3bbd17ad03 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:04:29.919752 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:29.920361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:29.927466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:29.932005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:29.932005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:29.932005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:30.137142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:30.150904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:30.157590 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:30.158699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c04620cc-e3ce-4496-9315-601cd0dab85a tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.248879 Sep 15 09:04:30.159207 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 539/1027] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:29 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:30.866126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-524b4afa-75ff-4fc1-9d65-a2d4c714adae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "effdc76f-1b40-4b3e-872a-b33374c4331b"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:30.867593 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-524b4afa-75ff-4fc1-9d65-a2d4c714adae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:30.875923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-524b4afa-75ff-4fc1-9d65-a2d4c714adae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:30.876363 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-524b4afa-75ff-4fc1-9d65-a2d4c714adae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:30.877165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-524b4afa-75ff-4fc1-9d65-a2d4c714adae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:30.877589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-524b4afa-75ff-4fc1-9d65-a2d4c714adae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:31.182064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:31.183404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:31.191059 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:31.191583 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:31.192414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:31.193062 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:31.399404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:31.415162 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:31.422547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:31.423690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ef2aafb1-889f-4488-8f9a-99700d548786 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.250961 Sep 15 09:04:31.424217 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 540/1028] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:31 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:32.447086 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:32.447707 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:32.461870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:32.462303 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:32.463091 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:32.463526 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:32.687191 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:32.701354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:32.707509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:32.708618 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f253cf95-424b-4974-ad92-2114c3313d15 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.271776 Sep 15 09:04:32.709158 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 541/1029] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:32 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:33.731995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:33.732750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:33.740496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:33.740939 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:33.741969 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:33.742427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:33.952816 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:33.967236 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:33.973794 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:33.975043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b449496e-1d19-4c85-aaf0-bd71d5846380 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.252179 Sep 15 09:04:33.975684 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 542/1030] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:33 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:35.001273 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:35.002035 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:35.009488 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:35.009934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:35.010752 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:35.011218 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:35.226186 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:35.240142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:35.246627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:35.248300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-742e6e85-ec6b-4f33-be29-f82d2f93fff3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.258530 Sep 15 09:04:35.248802 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 543/1031] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:34 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:36.272800 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:36.273596 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:36.283072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:36.283072 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:36.283384 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:36.284079 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:36.519478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:36.533826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:36.541236 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:36.542490 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c29a3496-11e0-4f87-acc6-d060b1dc1899 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.279747 Sep 15 09:04:36.543239 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 544/1032] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:36 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:37.569364 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:37.570166 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:37.577760 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:37.578225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:37.578997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:37.579426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:37.795637 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:37.811110 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:37.817457 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:37.818744 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f4e4d231-46cb-43c3-8412-8cf6c43ceac7 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.259678 Sep 15 09:04:37.819300 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 545/1033] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:37 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:38.843065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:38.843881 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:38.851611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:38.852173 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:38.853113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:38.853631 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:39.085108 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:39.099611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:39.105825 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:39.106991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9fc20a6e-6282-48a3-985d-74602edd2f4b tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.274006 Sep 15 09:04:39.107525 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 546/1034] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:38 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:40.131806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:40.133729 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:40.141806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:40.142524 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:40.143758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:40.144345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:40.355243 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:40.371477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:40.382887 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:40.384111 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d6a84676-43bd-42aa-b22b-df39bcb890e3 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.262419 Sep 15 09:04:40.384627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 547/1035] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:40 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:41.408245 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:41.408944 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:41.416026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:41.416467 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:41.417268 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:41.417694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:41.434730 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-524b4afa-75ff-4fc1-9d65-a2d4c714adae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.578824 Sep 15 09:04:41.440520 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 489/1036] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:04:30 2021] POST /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments => generated 194 bytes in 10581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:04:41.643693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:41.659173 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:41.665319 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:41.666433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-35b8027c-1f29-4f13-b9b5-716c255473ad tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.267766 Sep 15 09:04:41.666953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 548/1037] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:41 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:04:42.691052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:42.691725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:42.702636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:42.703073 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:42.703851 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:42.704273 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:42.902592 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:42.916296 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:42.922411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:42.923490 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-596b0d61-2f29-4be2-bee0-e334112f2b53 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.242502 Sep 15 09:04:42.924011 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 490/1038] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:42 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:43.946075 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:43.946666 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:43.953824 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:43.954312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:43.955076 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:43.955504 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:44.156364 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:44.170257 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:44.176442 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:44.177533 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ff9bb3ba-7aed-4dbc-8c54-be630fdc61f1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.240745 Sep 15 09:04:44.178050 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 549/1039] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:43 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:45.200920 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:45.201530 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:45.211185 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:45.211662 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:45.212429 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:45.212858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:45.416962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:45.431374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:45.437752 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:45.449253 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-71b812e0-02b2-4d59-ad7a-59bea79401cf tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.247190 Sep 15 09:04:45.449253 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 491/1040] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:45 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:46.462627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:46.463172 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:46.470691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:46.471130 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:46.471887 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:46.472316 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:46.671644 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:46.685386 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:46.691567 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:46.692657 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0e2aaa40-cf44-4ea4-bf6d-55025767e4f9 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.239270 Sep 15 09:04:46.693178 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 550/1041] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:46 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:46.928398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-72fb167b-9b35-4690-8341-ef861e98b1f4 req-9bf6b939-c83a-4f7d-ae1b-eb176928f29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea6d38f-dd74-452c-b2ad-51db3fe58d6e", "name": "network-vif-plugged", "status": "completed", "tag": "e9ff7f1c-60ef-492f-a949-c6144ac7bdcb"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:46.934804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:04:46.934804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:04:46.943325 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-72fb167b-9b35-4690-8341-ef861e98b1f4 req-9bf6b939-c83a-4f7d-ae1b-eb176928f29b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:46.943760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-72fb167b-9b35-4690-8341-ef861e98b1f4 req-9bf6b939-c83a-4f7d-ae1b-eb176928f29b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:46.960541 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-72fb167b-9b35-4690-8341-ef861e98b1f4 req-9bf6b939-c83a-4f7d-ae1b-eb176928f29b service nova] Creating event network-vif-plugged:e9ff7f1c-60ef-492f-a949-c6144ac7bdcb for instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e on hv-cinder-80600 Sep 15 09:04:46.965211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-72fb167b-9b35-4690-8341-ef861e98b1f4 req-9bf6b939-c83a-4f7d-ae1b-eb176928f29b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046439 Sep 15 09:04:46.967825 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 492/1042] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:04:47.716009 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:47.716559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:47.723899 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:47.724374 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:47.725131 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:47.725559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:47.926627 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:47.940265 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:47.946587 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:47.947736 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1f67438c-466c-4d64-9fbc-4fe13e7933c6 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.240972 Sep 15 09:04:47.948268 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 551/1043] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:47 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:48.972093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:48.972783 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:48.980129 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:48.980571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:48.981330 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:48.981758 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:49.208814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:49.223364 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:49.229727 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:49.230932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e58b2e72-998e-47c6-99c1-8809078a5c5d tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1729 microversion: 2.20 time: 0.269271 Sep 15 09:04:49.232070 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 493/1044] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:48 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1729 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:49.349180 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7a9543b8-a1f3-4684-bc87-02f016471805 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:49.350033 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7a9543b8-a1f3-4684-bc87-02f016471805 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:49.358400 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a9543b8-a1f3-4684-bc87-02f016471805 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:49.358854 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a9543b8-a1f3-4684-bc87-02f016471805 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:49.359612 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a9543b8-a1f3-4684-bc87-02f016471805 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:49.360077 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7a9543b8-a1f3-4684-bc87-02f016471805 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:49.429760 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7a9543b8-a1f3-4684-bc87-02f016471805 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090774 Sep 15 09:04:49.430324 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 552/1045] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:04:49 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:04:49.676240 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-af2aeb34-def2-485d-bc92-2364eea6011f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:49.676668 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-af2aeb34-def2-485d-bc92-2364eea6011f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:49.683820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-af2aeb34-def2-485d-bc92-2364eea6011f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:49.684260 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-af2aeb34-def2-485d-bc92-2364eea6011f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:49.685062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-af2aeb34-def2-485d-bc92-2364eea6011f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:49.685493 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-af2aeb34-def2-485d-bc92-2364eea6011f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:49.754406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-af2aeb34-def2-485d-bc92-2364eea6011f tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/6034daca-601a-4b9e-8586-da3bbd17ad03" status: 200 len: 194 microversion: 2.1 time: 0.087417 Sep 15 09:04:49.754971 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 494/1046] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Sep 15 09:04:49 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/6034daca-601a-4b9e-8586-da3bbd17ad03 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:04:49.770474 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-14ce0432-ff63-4d1b-b0d8-114cd12f87eb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:49.770983 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-14ce0432-ff63-4d1b-b0d8-114cd12f87eb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:49.778723 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-14ce0432-ff63-4d1b-b0d8-114cd12f87eb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:49.779185 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-14ce0432-ff63-4d1b-b0d8-114cd12f87eb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:49.779945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-14ce0432-ff63-4d1b-b0d8-114cd12f87eb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:49.780376 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-14ce0432-ff63-4d1b-b0d8-114cd12f87eb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:50.163922 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-14ce0432-ff63-4d1b-b0d8-114cd12f87eb tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/6034daca-601a-4b9e-8586-da3bbd17ad03" status: 202 len: 0 microversion: 2.1 time: 0.403147 Sep 15 09:04:50.164501 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 553/1047] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:04:49 2021] DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/6034daca-601a-4b9e-8586-da3bbd17ad03 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:04:50.257361 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:50.257962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:50.266296 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:50.266735 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:50.267489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:50.267910 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:50.477932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:50.491845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:50.498536 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:50.499620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-64171ba8-4590-4369-86be-e4f76e99e260 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1716 microversion: 2.20 time: 0.253251 Sep 15 09:04:50.500132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 495/1048] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:04:50 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1716 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:04:52.453708 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0cae5429-1be4-4c57-8ab8-ea802c6c4129 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:52.454301 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0cae5429-1be4-4c57-8ab8-ea802c6c4129 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:52.461594 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cae5429-1be4-4c57-8ab8-ea802c6c4129 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:52.462026 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cae5429-1be4-4c57-8ab8-ea802c6c4129 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:52.462830 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cae5429-1be4-4c57-8ab8-ea802c6c4129 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:52.463254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0cae5429-1be4-4c57-8ab8-ea802c6c4129 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:52.530012 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0cae5429-1be4-4c57-8ab8-ea802c6c4129 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/effdc76f-1b40-4b3e-872a-b33374c4331b" status: 200 len: 194 microversion: 2.1 time: 0.086846 Sep 15 09:04:52.530607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 554/1049] 10.222.0.39 () {58 vars in 1413 bytes} [Wed Sep 15 09:04:52 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/effdc76f-1b40-4b3e-872a-b33374c4331b => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:04:52.546322 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-855c554a-b147-4751-8dae-4365dd04e4fd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:52.546839 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-855c554a-b147-4751-8dae-4365dd04e4fd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:52.553926 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-855c554a-b147-4751-8dae-4365dd04e4fd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:52.554580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-855c554a-b147-4751-8dae-4365dd04e4fd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:52.555341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-855c554a-b147-4751-8dae-4365dd04e4fd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:52.555763 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-855c554a-b147-4751-8dae-4365dd04e4fd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:52.926132 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-855c554a-b147-4751-8dae-4365dd04e4fd tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/effdc76f-1b40-4b3e-872a-b33374c4331b" status: 202 len: 0 microversion: 2.1 time: 0.389688 Sep 15 09:04:52.926916 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 496/1050] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:04:52 2021] DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments/effdc76f-1b40-4b3e-872a-b33374c4331b => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:04:54.357013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-443dac65-6666-46da-9eb5-8f049ebfe0d8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:54.357988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-443dac65-6666-46da-9eb5-8f049ebfe0d8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:54.365165 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-443dac65-6666-46da-9eb5-8f049ebfe0d8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:54.365602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-443dac65-6666-46da-9eb5-8f049ebfe0d8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:54.366655 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-443dac65-6666-46da-9eb5-8f049ebfe0d8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:54.367085 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-443dac65-6666-46da-9eb5-8f049ebfe0d8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:54.434226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-443dac65-6666-46da-9eb5-8f049ebfe0d8 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087176 Sep 15 09:04:54.434764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 555/1051] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:04:54 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:04:54.636187 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-856d8063-a806-42ab-ab69-fe79d3e171a2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:54.637220 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-856d8063-a806-42ab-ab69-fe79d3e171a2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:54.644526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856d8063-a806-42ab-ab69-fe79d3e171a2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:54.644962 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856d8063-a806-42ab-ab69-fe79d3e171a2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:54.645703 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856d8063-a806-42ab-ab69-fe79d3e171a2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:54.646150 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-856d8063-a806-42ab-ab69-fe79d3e171a2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:54.713225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-856d8063-a806-42ab-ab69-fe79d3e171a2 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086593 Sep 15 09:04:54.713759 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 497/1052] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:04:54 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:04:54.814689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:54.815171 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:54.822131 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:54.822573 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:54.823321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:54.823741 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:54.886935 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:04:55.219302 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9ddedc38-5e56-4cfd-b016-09e6541ced5e tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 204 len: 0 microversion: 2.1 time: 0.413270 Sep 15 09:04:55.219874 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 556/1053] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:04:54 2021] DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:04:55.233478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:55.235753 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:55.241303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:55.241996 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:55.242794 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:55.243218 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:55.443845 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:55.452587 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f7d176ff-d1ff-45a2-adde-ca5c581f29ae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1671 microversion: 2.1 time: 0.228118 Sep 15 09:04:55.455378 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 498/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:04:55 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:04:56.476363 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:56.476982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:56.484125 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:56.484560 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:56.485309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:56.485732 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:56.683788 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:56.692288 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9843c470-7160-4b7c-bf18-8b694f7dd1be tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1671 microversion: 2.1 time: 0.225713 Sep 15 09:04:56.692809 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 557/1055] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:04:56 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:04:57.715730 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:57.716375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:57.724041 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:57.724497 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:57.725252 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:57.725681 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:58.032847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:58.040923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-fa3f09cc-fcc1-49a9-ba3f-fd83541824e4 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1671 microversion: 2.1 time: 0.334972 Sep 15 09:04:58.041457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 499/1056] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:04:57 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1671 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:04:58.632687 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-35d5649b-8477-40a7-ace0-7a6b043dd9e3 req-e69d21c7-651c-439e-90f5-846f20c0822b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6167b622-02e3-4984-a72d-7207ecf18083", "name": "network-vif-deleted", "tag": "359c3531-b0d1-46c7-b8ca-76ca44ed7e15"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:04:58.639194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:04:58.639194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:04:58.647420 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-35d5649b-8477-40a7-ace0-7a6b043dd9e3 req-e69d21c7-651c-439e-90f5-846f20c0822b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:58.647757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-35d5649b-8477-40a7-ace0-7a6b043dd9e3 req-e69d21c7-651c-439e-90f5-846f20c0822b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:58.666498 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-35d5649b-8477-40a7-ace0-7a6b043dd9e3 req-e69d21c7-651c-439e-90f5-846f20c0822b service nova] Creating event network-vif-deleted:359c3531-b0d1-46c7-b8ca-76ca44ed7e15 for instance 6167b622-02e3-4984-a72d-7207ecf18083 on hv-cinder-80600 Sep 15 09:04:58.673290 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-35d5649b-8477-40a7-ace0-7a6b043dd9e3 req-e69d21c7-651c-439e-90f5-846f20c0822b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049738 Sep 15 09:04:58.673938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 558/1057] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:04:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:04:59.063455 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:04:59.064067 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:04:59.071539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:59.072189 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:59.072963 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:59.073391 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:59.147020 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:04:59.147462 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:04:59.147900 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lazy-loading 'fault' on Instance uuid 6167b622-02e3-4984-a72d-7207ecf18083 {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:04:59.270671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e692f5f7d4c8cb7dd9c0207ecf68f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aadda57f2be49a592d2dc246c4ce0ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:04:59.279455 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9373ac91-f10d-4266-a255-83f6b03ceeae tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 200 len: 1325 microversion: 2.1 time: 0.225127 Sep 15 09:04:59.279923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 500/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:04:59 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:05:00.302691 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:00.303405 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:00.311521 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:00.312668 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:00.312668 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:00.312963 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:00.363239 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] HTTP exception thrown: Instance 6167b622-02e3-4984-a72d-7207ecf18083 could not be found. Sep 15 09:05:00.363814 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Returning 404 to user: Instance 6167b622-02e3-4984-a72d-7207ecf18083 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:00.364770 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e041decd-7efc-41a0-9bf6-f8e0a684bf12 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 404 len: 111 microversion: 2.1 time: 0.072065 Sep 15 09:05:00.365309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 559/1059] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:05:00 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:00.379383 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-87655f51-b5d4-4b29-b6ab-9c1e37b09124 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '.version_select at 0x7f1ec67b69d0>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:00.468521 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-87655f51-b5d4-4b29-b6ab-9c1e37b09124 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-50648367" status: 202 len: 0 microversion: 2.1 time: 0.098492 Sep 15 09:05:00.469067 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 501/1060] 10.222.0.39 () {58 vars in 1215 bytes} [Wed Sep 15 09:05:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-50648367 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:05:04.492898 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:04.493515 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:04.501313 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:04.501759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:04.502549 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:04.502980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:04.554959 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] HTTP exception thrown: Instance 6167b622-02e3-4984-a72d-7207ecf18083 could not be found. Sep 15 09:05:04.555549 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Returning 404 to user: Instance 6167b622-02e3-4984-a72d-7207ecf18083 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:04.556358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-465ad67f-c247-4210-8462-28cde4839b74 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 404 len: 111 microversion: 2.1 time: 0.073466 Sep 15 09:05:04.556888 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 560/1061] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:05:04 2021] DELETE /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:04.570995 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:04.571619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 6167b622-02e3-4984-a72d-7207ecf18083] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:04.579580 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:04.580013 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:04.580758 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:04.581177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:04.629509 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] HTTP exception thrown: Instance 6167b622-02e3-4984-a72d-7207ecf18083 could not be found. Sep 15 09:05:04.630099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Returning 404 to user: Instance 6167b622-02e3-4984-a72d-7207ecf18083 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:04.630893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-18b6e8a0-f4c0-4246-9869-3e2dd5f3bc81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083" status: 404 len: 111 microversion: 2.1 time: 0.069827 Sep 15 09:05:04.631400 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 502/1062] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:05:04 2021] GET /compute/v2.1/servers/6167b622-02e3-4984-a72d-7207ecf18083 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:05.995400 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:05.996532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:06.003116 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:06.003562 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:06.004321 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:06.004751 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:06.055596 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] HTTP exception thrown: Instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 could not be found. Sep 15 09:05:06.056182 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Returning 404 to user: Instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:06.057049 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5f111806-5039-423d-b7e1-43fc9179ef95 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "DELETE /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 404 len: 111 microversion: 2.1 time: 0.071273 Sep 15 09:05:06.057581 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 561/1063] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:05:05 2021] DELETE /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:06.071049 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:06.071657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] [instance: 661af67d-f3ef-4c65-bcb6-a51b229ddbf0] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:06.079367 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:06.082569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:06.082569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:06.082569 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:06.129742 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] HTTP exception thrown: Instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 could not be found. Sep 15 09:05:06.130359 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] Returning 404 to user: Instance 661af67d-f3ef-4c65-bcb6-a51b229ddbf0 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:06.131178 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f88a27e8-9393-471d-94bf-ab6a89861e81 tempest-AttachVolumeTestJSON-226149614 tempest-AttachVolumeTestJSON-226149614-project] 10.222.0.39 "GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0" status: 404 len: 111 microversion: 2.1 time: 0.069463 Sep 15 09:05:06.131711 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 503/1064] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:05:06 2021] GET /compute/v2.1/servers/661af67d-f3ef-4c65-bcb6-a51b229ddbf0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:23.390725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-44ffe1ed-55b9-4f18-b0ae-76a72bace696 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:23.391633 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-44ffe1ed-55b9-4f18-b0ae-76a72bace696 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:23.398922 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44ffe1ed-55b9-4f18-b0ae-76a72bace696 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:23.399370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44ffe1ed-55b9-4f18-b0ae-76a72bace696 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:23.400129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44ffe1ed-55b9-4f18-b0ae-76a72bace696 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:23.400559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-44ffe1ed-55b9-4f18-b0ae-76a72bace696 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:23.467776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-44ffe1ed-55b9-4f18-b0ae-76a72bace696 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086500 Sep 15 09:05:23.468324 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 562/1065] 10.222.0.39 () {60 vars in 1343 bytes} [Wed Sep 15 09:05:23 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:05:23.574838 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:23.575370 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:23.582567 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:23.583007 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:23.583758 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:23.584185 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:23.663754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:05:23.944257 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2835c354-c64b-4423-9feb-52eea9dfaf0e tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 204 len: 0 microversion: 2.20 time: 0.378114 Sep 15 09:05:23.944831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 504/1066] 10.222.0.39 () {60 vars in 1280 bytes} [Wed Sep 15 09:05:23 2021] DELETE /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 09:05:23.965793 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:23.966452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:23.979995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:23.979995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:23.979995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:23.979995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:24.197599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:24.211414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:24.218569 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:24.219747 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8378a82e-fef5-4876-a356-cca0ac1d34b1 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.265718 Sep 15 09:05:24.220349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 563/1067] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:05:23 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 09:05:25.244729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:25.245398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:25.252630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:25.253068 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:25.253820 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:25.254276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:25.472646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:25.486623 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:25.493099 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:25.494259 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0dfbff28-e4f8-4214-b00f-eaa0877a99aa tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1722 microversion: 2.20 time: 0.259586 Sep 15 09:05:25.494786 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 505/1068] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:05:25 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:05:26.517683 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:26.518349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:26.525908 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:26.526394 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:26.527265 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:26.528011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:26.745798 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:26.770577 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:26.779269 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '662bcbb9a7fc49e8b1b2a3f4d8a2e100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f168b6f24dc4d93824606ca9470fea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:05:26.780960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d8a24651-d993-4577-91d2-cce415a14332 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 200 len: 1655 microversion: 2.20 time: 0.273085 Sep 15 09:05:26.781992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 564/1069] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:05:26 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 1655 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 09:05:27.062145 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-44f420fa-c291-44e3-9a5b-cb4c5b2a7ba0 req-84487c43-0276-493a-80fd-e2ca4496e930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea6d38f-dd74-452c-b2ad-51db3fe58d6e", "name": "network-vif-deleted", "tag": "e9ff7f1c-60ef-492f-a949-c6144ac7bdcb"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:05:27.069063 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:05:27.069063 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:05:27.078435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-44f420fa-c291-44e3-9a5b-cb4c5b2a7ba0 req-84487c43-0276-493a-80fd-e2ca4496e930 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:27.085182 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-44f420fa-c291-44e3-9a5b-cb4c5b2a7ba0 req-84487c43-0276-493a-80fd-e2ca4496e930 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:27.095723 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-44f420fa-c291-44e3-9a5b-cb4c5b2a7ba0 req-84487c43-0276-493a-80fd-e2ca4496e930 service nova] Creating event network-vif-deleted:e9ff7f1c-60ef-492f-a949-c6144ac7bdcb for instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e on hv-cinder-80600 Sep 15 09:05:27.100775 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-44f420fa-c291-44e3-9a5b-cb4c5b2a7ba0 req-84487c43-0276-493a-80fd-e2ca4496e930 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Sep 15 09:05:27.101854 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 506/1070] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:05:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:05:27.803601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:27.804194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:27.811438 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:27.816276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:27.816276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:27.816276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:27.863783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] HTTP exception thrown: Instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e could not be found. Sep 15 09:05:27.864470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Returning 404 to user: Instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:27.865367 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-60d488a3-7104-4662-9080-100020e7c8ff tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 404 len: 111 microversion: 2.20 time: 0.071137 Sep 15 09:05:27.865975 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 565/1071] 10.222.0.39 () {60 vars in 1277 bytes} [Wed Sep 15 09:05:27 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 09:05:27.883507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-80ef909a-f8fd-4ed1-890f-ac090e553db8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '.version_select at 0x7f1ec6871b80>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:27.980138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-80ef909a-f8fd-4ed1-890f-ac090e553db8 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276257989" status: 204 len: 0 microversion: 2.20 time: 0.108763 Sep 15 09:05:27.980822 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 507/1072] 10.222.0.39 () {60 vars in 1262 bytes} [Wed Sep 15 09:05:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276257989 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 09:05:31.752038 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:31.752533 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:31.759541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:31.759978 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:31.760740 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:31.761199 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:31.810900 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] HTTP exception thrown: Instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e could not be found. Sep 15 09:05:31.811487 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Returning 404 to user: Instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:31.812309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-037d58fd-a7d8-4f80-9932-cbc19ef195d5 tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 404 len: 111 microversion: 2.1 time: 0.069320 Sep 15 09:05:31.812859 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 566/1073] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:05:31 2021] DELETE /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:31.827148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:31.827861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: eea6d38f-dd74-452c-b2ad-51db3fe58d6e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:31.835137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:31.835573 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:31.836323 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:31.836749 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:31.890372 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] HTTP exception thrown: Instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e could not be found. Sep 15 09:05:31.890955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Returning 404 to user: Instance eea6d38f-dd74-452c-b2ad-51db3fe58d6e could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:31.891761 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b50106b6-db40-4087-a984-ee6ae8328bea tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e" status: 404 len: 111 microversion: 2.1 time: 0.074849 Sep 15 09:05:31.892292 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 508/1074] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:05:31 2021] GET /compute/v2.1/servers/eea6d38f-dd74-452c-b2ad-51db3fe58d6e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:33.258179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:33.258693 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:33.266206 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:33.266651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:33.267415 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:33.267874 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:33.319436 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] HTTP exception thrown: Instance 5ba14ca7-eb88-437e-9c49-5101925f639b could not be found. Sep 15 09:05:33.320011 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Returning 404 to user: Instance 5ba14ca7-eb88-437e-9c49-5101925f639b could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:33.320824 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dd28a52c-b14b-46fc-a9fb-ef3036b0970f tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 404 len: 111 microversion: 2.1 time: 0.071700 Sep 15 09:05:33.321361 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 567/1075] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:05:33 2021] DELETE /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:05:33.336483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:05:33.337088 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] [instance: 5ba14ca7-eb88-437e-9c49-5101925f639b] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:05:33.344424 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:33.344861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:33.345683 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:05:33.346054 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:05:33.397249 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] HTTP exception thrown: Instance 5ba14ca7-eb88-437e-9c49-5101925f639b could not be found. Sep 15 09:05:33.397833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] Returning 404 to user: Instance 5ba14ca7-eb88-437e-9c49-5101925f639b could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:05:33.398688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5a0749f5-9b71-48e6-bf52-cc9a5ce159da tempest-AttachVolumeShelveTestJSON-742724906 tempest-AttachVolumeShelveTestJSON-742724906-project] 10.222.0.39 "GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b" status: 404 len: 111 microversion: 2.1 time: 0.072291 Sep 15 09:05:33.399200 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 509/1076] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:05:33 2021] GET /compute/v2.1/servers/5ba14ca7-eb88-437e-9c49-5101925f639b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:07:04.278517 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 09:07:04.287801 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ba1fefa2-9bb4-48cd-923f-652ffbe290d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Action: 'create', calling method: .version_select at 0x7f1ec6415040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1840160698"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:04.298340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:07:04.298490 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:07:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.39) !!! Sep 15 09:07:04.327757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-ba1fefa2-9bb4-48cd-923f-652ffbe290d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Getting quotas for project 29c8fbe80a454d26895eb9dd55dbfa6f. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:07:04.332240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-ba1fefa2-9bb4-48cd-923f-652ffbe290d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Getting quotas for user ee468ff40b1741b1af37adb558a0517b and project 29c8fbe80a454d26895eb9dd55dbfa6f. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:07:04.599722 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-ba1fefa2-9bb4-48cd-923f-652ffbe290d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Getting quotas for project 29c8fbe80a454d26895eb9dd55dbfa6f. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:07:04.603374 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-ba1fefa2-9bb4-48cd-923f-652ffbe290d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Getting quotas for user ee468ff40b1741b1af37adb558a0517b and project 29c8fbe80a454d26895eb9dd55dbfa6f. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:07:04.615828 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ba1fefa2-9bb4-48cd-923f-652ffbe290d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.338591 Sep 15 09:07:04.616409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 568/1077] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Sep 15 09:07:04 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:04.725177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-636383763", "imageRef": "9acfb93c-d40f-4f15-a382-be56b15e5328", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1840160698", "networks": [{"uuid": "6760c63b-f0a8-416b-867e-4321d12726c6"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:04.746335 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 09:07:04.747301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:07:04.747445 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:07:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Sep 15 09:07:04.806473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] validate_networks() for [('6760c63b-f0a8-416b-867e-4321d12726c6', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:07:05.582289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:07:05.582725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:07:05.583208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:07:05.583604 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:07:05.584002 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:07:05.592605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:05.593038 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:05.594442 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:05.594867 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:05.613928 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Getting quotas for project 29c8fbe80a454d26895eb9dd55dbfa6f. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:07:05.618631 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Getting quotas for user ee468ff40b1741b1af37adb558a0517b and project 29c8fbe80a454d26895eb9dd55dbfa6f. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:07:05.629671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:07:05.632064 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9acfb93c-d40f-4f15-a382-be56b15e5328',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:07:05.763879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d3304955-f938-40f8-9525-8fbe62ea4572 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047716 Sep 15 09:07:05.764523 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 510/1078] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:07:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 09:07:05.795342 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6ef331bf-b62b-425a-9203-da50fe5a5a82 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:05.795342 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6ef331bf-b62b-425a-9203-da50fe5a5a82 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:05.803078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46106. Sep 15 09:07:05.881472 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6ef331bf-b62b-425a-9203-da50fe5a5a82 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:05.889399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6ef331bf-b62b-425a-9203-da50fe5a5a82 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1258 microversion: 2.1 time: 0.118584 Sep 15 09:07:05.890169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 569/1079] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:05 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1258 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:06.913102 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:06.913701 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:06.921301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46102. Sep 15 09:07:06.927795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:06.928232 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:06.928989 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:06.929413 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:07.052840 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:07.061097 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b1235927-adc1-464d-abc8-bbe469347b93 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1262 microversion: 2.1 time: 0.158251 Sep 15 09:07:07.061626 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 511/1080] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:06 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:08.083843 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:08.084448 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:08.092516 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:08.092958 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:08.094033 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:08.094712 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:08.229305 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:08.237889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-25dd9169-5bd6-4df1-bf60-d59b7f19d7d7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1318 microversion: 2.1 time: 0.163990 Sep 15 09:07:08.238514 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 570/1081] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:08 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:09.262861 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:09.263689 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:09.272092 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:09.273107 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:09.273989 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:09.274537 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:09.562050 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:09.578405 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ae29c61d-56a6-4ba4-9416-266897ca8f34 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1316 microversion: 2.1 time: 0.326063 Sep 15 09:07:09.580020 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 512/1082] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:09 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:10.604086 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:10.605350 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:10.613946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:10.614948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:10.616599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:10.617556 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:10.887498 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:10.896932 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c5295991-d5df-4c46-ae26-91ea3145bf6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.303794 Sep 15 09:07:10.907309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 571/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:10 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:11.924677 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:11.924677 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:11.927386 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:11.927825 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:11.928583 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:11.929009 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:12.257378 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:12.265699 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0d6e8cce-b0ef-49e8-8585-ce5fe282cc3f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.355215 Sep 15 09:07:12.266414 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 513/1084] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:11 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:13.291187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:13.292454 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:13.299717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:13.300154 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:13.301101 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:13.301529 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:13.528086 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:13.537443 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-421973a1-b869-409f-83ef-1b570a68b605 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.256981 Sep 15 09:07:13.538335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 572/1085] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:13 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:14.559847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:14.560476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:14.573168 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:14.576601 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:14.576601 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:14.576601 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:14.814160 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:14.823372 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-be877f27-f0dc-4bc8-8909-d4bed816c315 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.272798 Sep 15 09:07:14.833093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 514/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:14 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:15.849122 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:15.850711 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:15.859728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:15.860485 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:15.861743 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:15.862393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:16.119759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:16.128959 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-abaed3b4-d691-4eec-bbca-1b6e7850d852 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.291536 Sep 15 09:07:16.133023 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 573/1087] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:15 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:17.152690 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:17.153266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:17.171788 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:17.174943 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:17.174943 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:17.174943 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:17.412495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:17.421701 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e8d14e27-1e19-4e97-8a00-4c1595d098c4 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.278836 Sep 15 09:07:17.426936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 515/1088] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:17 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:18.448194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:18.448942 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:18.458720 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:18.459292 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:18.460279 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:18.460850 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:18.763551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:18.763551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a8497571-ee85-4361-8809-69e04690bc6a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.294506 Sep 15 09:07:18.763551 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 574/1089] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:18 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:19.785377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:19.785986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:19.793408 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:19.793858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:19.795572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:19.795572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:20.203295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:20.211504 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5cdb5267-21f9-4cd7-a8a7-6041be25fe25 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.435439 Sep 15 09:07:20.212148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 516/1090] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:19 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:07:20.877860 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-adcce5ed-7b8f-4ae2-b162-6ba217e680b2 req-3a0ac0b2-1fde-436f-af3b-d608caa309a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4df0363-1513-4e8f-b334-57c308931090", "tag": "68444aa9-d7ab-46c3-a964-8060a8a46688"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:20.891098 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:07:20.891098 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:07:20.899726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-adcce5ed-7b8f-4ae2-b162-6ba217e680b2 req-3a0ac0b2-1fde-436f-af3b-d608caa309a0 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:20.900168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-adcce5ed-7b8f-4ae2-b162-6ba217e680b2 req-3a0ac0b2-1fde-436f-af3b-d608caa309a0 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:20.917358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-adcce5ed-7b8f-4ae2-b162-6ba217e680b2 req-3a0ac0b2-1fde-436f-af3b-d608caa309a0 service nova] Creating event network-changed:68444aa9-d7ab-46c3-a964-8060a8a46688 for instance e4df0363-1513-4e8f-b334-57c308931090 on hv-cinder-80600 Sep 15 09:07:20.920660 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [req-adcce5ed-7b8f-4ae2-b162-6ba217e680b2 req-3a0ac0b2-1fde-436f-af3b-d608caa309a0 service nova] [4b40b18b-3120-4fad-8192-959bd1825b77] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 09:07:21.234972 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:21.235582 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:21.243251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:21.244067 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:21.244833 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:21.245258 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:21.702163 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:21.710553 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-154b78bb-9b3e-49e3-8051-7bb32d1c95ca tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.485598 Sep 15 09:07:21.711075 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 517/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:21 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:07:21.938679 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [req-adcce5ed-7b8f-4ae2-b162-6ba217e680b2 req-3a0ac0b2-1fde-436f-af3b-d608caa309a0 service nova] [4b40b18b-3120-4fad-8192-959bd1825b77] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46326. Sep 15 09:07:21.941860 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-adcce5ed-7b8f-4ae2-b162-6ba217e680b2 req-3a0ac0b2-1fde-436f-af3b-d608caa309a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.074633 Sep 15 09:07:21.942470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 575/1092] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:07:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:07:22.732374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:22.732891 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:22.740763 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:22.741202 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:22.741966 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:22.742419 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:22.944629 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:22.952698 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f40c1ba9-867f-4765-bea4-a8442fc10197 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.229463 Sep 15 09:07:22.953218 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 518/1093] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:22 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:23.975056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:23.975749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:23.982994 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:23.984065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:23.984845 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:23.985254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:24.190542 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:24.198659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8621e3d0-5c0a-476b-bad5-38d8f4a3f3e7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.233767 Sep 15 09:07:24.199323 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 576/1094] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:23 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:25.221810 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:25.222447 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:25.229774 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:25.230243 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:25.231018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:25.231455 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:25.436170 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:25.444615 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-de412207-2077-46a6-bba0-ed0ba9fb5c9f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.232920 Sep 15 09:07:25.445130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 519/1095] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:25 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:26.467295 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:26.468465 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:26.475484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:26.475924 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:26.476677 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:26.477103 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:26.682054 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:26.690064 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-7d7f8a5e-70fb-4e13-a8c8-d039de81d5c1 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.231797 Sep 15 09:07:26.690630 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 577/1096] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:26 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:27.712127 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:27.712736 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:27.721101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:27.721544 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:27.722354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:27.722789 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:27.893516 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-128cd2ca-cf34-44ad-a59e-8f9e8f69c7c9 req-9fbaa12b-5d02-4247-9c5e-180d9ee69f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4df0363-1513-4e8f-b334-57c308931090", "name": "network-vif-plugged", "status": "completed", "tag": "68444aa9-d7ab-46c3-a964-8060a8a46688"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:27.900192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:07:27.900192 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:07:27.909410 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-128cd2ca-cf34-44ad-a59e-8f9e8f69c7c9 req-9fbaa12b-5d02-4247-9c5e-180d9ee69f9b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:27.909844 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-128cd2ca-cf34-44ad-a59e-8f9e8f69c7c9 req-9fbaa12b-5d02-4247-9c5e-180d9ee69f9b service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:27.927067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-128cd2ca-cf34-44ad-a59e-8f9e8f69c7c9 req-9fbaa12b-5d02-4247-9c5e-180d9ee69f9b service nova] Creating event network-vif-plugged:68444aa9-d7ab-46c3-a964-8060a8a46688 for instance e4df0363-1513-4e8f-b334-57c308931090 on hv-cinder-80600 Sep 15 09:07:27.933133 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-128cd2ca-cf34-44ad-a59e-8f9e8f69c7c9 req-9fbaa12b-5d02-4247-9c5e-180d9ee69f9b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049506 Sep 15 09:07:27.933725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 578/1097] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:07:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:07:27.945922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:27.955607 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f8992383-3608-41a1-9ef4-5b3dafb757b2 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.252558 Sep 15 09:07:27.965023 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 520/1098] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:27 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:28.978783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:28.979456 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:28.987573 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:28.988014 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:28.988819 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:28.989248 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:29.216538 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:29.225018 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-82e977dd-1780-4631-9ba3-dd7f3661058a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1358 microversion: 2.1 time: 0.255973 Sep 15 09:07:29.225536 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 579/1099] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:28 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:30.248425 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:30.249648 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:30.257231 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:30.257671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:30.258473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:30.258902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:30.471619 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:30.479608 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-eb0c3cd7-9482-4c80-99cb-2f28e349d675 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1548 microversion: 2.1 time: 0.240954 Sep 15 09:07:30.480130 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 521/1100] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:30 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:30.502283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:30.502883 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:30.510488 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:30.511003 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:30.511756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:30.512181 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:30.723306 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:30.731971 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-e724ba6e-977f-4a89-a6c4-02b1efbeef72 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1548 microversion: 2.1 time: 0.239686 Sep 15 09:07:30.733559 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 580/1101] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:30 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1548 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:30.754285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:30.767645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:07:30.767645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:07:30.768795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:30.769578 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Searching by: {'deleted': False, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f'} {{(pid=89583) get_all /opt/stack/nova/nova/compute/api.py:2852}} Sep 15 09:07:30.775341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:30.775778 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:30.776571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:30.777000 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:30.870183 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.multi_cell_list [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=89583) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 15 09:07:31.098902 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-14a57630-4cd5-46ab-af92-e3723f234c0a tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.353786 Sep 15 09:07:31.099458 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 522/1102] 10.222.0.39 () {58 vars in 1125 bytes} [Wed Sep 15 09:07:30 2021] GET /compute/v2.1/servers => generated 342 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:07:31.114607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:31.115211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:31.124218 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:31.124732 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:31.125557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:31.126363 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:31.324937 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:31.333411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-255ac67d-cd4d-45d1-afb4-9c13a026c760 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1548 microversion: 2.1 time: 0.227900 Sep 15 09:07:31.333936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 581/1103] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:31 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:33.480811 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-028a169c-0ce9-4409-943a-5f6c215ea694 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3e83977-c904-48f5-9e27-3931379fdbb3"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:33.481849 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-028a169c-0ce9-4409-943a-5f6c215ea694 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:33.489621 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-028a169c-0ce9-4409-943a-5f6c215ea694 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:33.490060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-028a169c-0ce9-4409-943a-5f6c215ea694 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:33.491102 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-028a169c-0ce9-4409-943a-5f6c215ea694 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:33.491529 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-028a169c-0ce9-4409-943a-5f6c215ea694 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:34.360259 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-028a169c-0ce9-4409-943a-5f6c215ea694 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888440 Sep 15 09:07:34.360872 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 523/1104] 10.222.0.39 () {60 vars in 1323 bytes} [Wed Sep 15 09:07:33 2021] POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:07:42.315379 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:42.315980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:42.323254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:42.323730 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:42.324483 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:42.324913 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:42.526957 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:42.535599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0b55c732-d7e1-4301-a1ca-0b3e56224a9c tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1594 microversion: 2.1 time: 0.229318 Sep 15 09:07:42.536146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 582/1105] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:42 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1594 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:07:45.699756 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-88dbccb8-6f37-4dd8-9276-e9e5b01acc85 req-c4de9a60-6f98-437d-8e5d-370334452b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4df0363-1513-4e8f-b334-57c308931090", "tag": "68444aa9-d7ab-46c3-a964-8060a8a46688"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:45.706635 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:07:45.706635 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:07:45.716175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-88dbccb8-6f37-4dd8-9276-e9e5b01acc85 req-c4de9a60-6f98-437d-8e5d-370334452b2d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:45.720215 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-88dbccb8-6f37-4dd8-9276-e9e5b01acc85 req-c4de9a60-6f98-437d-8e5d-370334452b2d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:45.732223 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-88dbccb8-6f37-4dd8-9276-e9e5b01acc85 req-c4de9a60-6f98-437d-8e5d-370334452b2d service nova] Creating event network-changed:68444aa9-d7ab-46c3-a964-8060a8a46688 for instance e4df0363-1513-4e8f-b334-57c308931090 on hv-cinder-80600 Sep 15 09:07:45.737111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-88dbccb8-6f37-4dd8-9276-e9e5b01acc85 req-c4de9a60-6f98-437d-8e5d-370334452b2d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047863 Sep 15 09:07:45.738018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 524/1106] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:07:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:07:48.567822 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-404538341"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:48.568385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:48.575592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:48.576036 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:48.577478 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:48.577903 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:48.908121 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.network.security_group_api [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Adding security group 25ccf4df-fde4-40c2-af84-6aa333d4b1b3 to port 68444aa9-d7ab-46c3-a964-8060a8a46688 Sep 15 09:07:49.526817 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5a74d7c0-6fc6-44e3-8a40-764d0ccde66e tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/action" status: 202 len: 0 microversion: 2.1 time: 0.968605 Sep 15 09:07:49.528413 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 583/1107] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:07:48 2021] POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/action => generated 0 bytes in 971 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:07:49.547350 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-31d5694a-4dcb-4464-874b-d285f699fe4c req-34e41d32-eb2c-457a-8bba-382abcae4c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4df0363-1513-4e8f-b334-57c308931090", "tag": "68444aa9-d7ab-46c3-a964-8060a8a46688"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:07:49.550440 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:07:49.552028 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:07:49.553932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:07:49.553932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:07:49.563058 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:49.563763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:49.565116 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:49.565758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:49.570658 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-31d5694a-4dcb-4464-874b-d285f699fe4c req-34e41d32-eb2c-457a-8bba-382abcae4c2c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:07:49.574074 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-31d5694a-4dcb-4464-874b-d285f699fe4c req-34e41d32-eb2c-457a-8bba-382abcae4c2c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:07:49.587979 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-31d5694a-4dcb-4464-874b-d285f699fe4c req-34e41d32-eb2c-457a-8bba-382abcae4c2c service nova] Creating event network-changed:68444aa9-d7ab-46c3-a964-8060a8a46688 for instance e4df0363-1513-4e8f-b334-57c308931090 on hv-cinder-80600 Sep 15 09:07:49.592836 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-31d5694a-4dcb-4464-874b-d285f699fe4c req-34e41d32-eb2c-457a-8bba-382abcae4c2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060631 Sep 15 09:07:49.593934 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 525/1108] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:07:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:07:49.976945 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:07:49.986586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5d4befce-8c68-4e28-875b-93abf9ec7876 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1759 microversion: 2.1 time: 0.453237 Sep 15 09:07:49.987129 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 584/1109] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:07:49 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1759 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:03.788049 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e0e30b40-7f9d-4420-b613-79a8eb9a8128 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:08:03.789061 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e0e30b40-7f9d-4420-b613-79a8eb9a8128 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:03.796664 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e0e30b40-7f9d-4420-b613-79a8eb9a8128 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:03.797142 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e0e30b40-7f9d-4420-b613-79a8eb9a8128 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:03.797926 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e0e30b40-7f9d-4420-b613-79a8eb9a8128 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:03.798387 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e0e30b40-7f9d-4420-b613-79a8eb9a8128 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:04.114457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e0e30b40-7f9d-4420-b613-79a8eb9a8128 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/action" status: 202 len: 0 microversion: 2.1 time: 0.336195 Sep 15 09:08:04.115366 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 526/1110] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:08:03 2021] POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:08:04.131375 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:04.135021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:04.139352 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:04.139796 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:04.140718 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:04.141146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:04.350757 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:04.360308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-24b6f9d4-a51b-4bde-9c32-d7ef02aa54c8 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1751 microversion: 2.1 time: 0.240844 Sep 15 09:08:04.361817 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 585/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:04 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1751 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:08:05.385233 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:05.385906 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:05.393450 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:05.393886 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:05.394686 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:05.395113 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:05.749419 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:05.757942 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-552ce550-fb29-4275-aa7a-1371210d1584 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.382361 Sep 15 09:08:05.758505 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 527/1112] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:05 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:06.780373 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:06.780901 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:06.788135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:06.788576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:06.789331 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:06.789758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:07.000247 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:07.008765 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-09dc2d7e-aa1d-4a6c-967b-aaa73b297dfa tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.237582 Sep 15 09:08:07.009287 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 586/1113] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:06 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:08.031303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:08.031853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:08.038956 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:08.039401 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:08.040175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:08.040595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:08.243837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:08.253052 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4228290a-778d-42ea-a4c8-f0c6940408a7 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.231014 Sep 15 09:08:08.253613 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 528/1114] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:08 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:09.275662 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:09.276196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:09.284022 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:09.284476 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:09.285226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:09.285651 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:09.485938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:09.494631 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f575572a-1c89-4be0-b0f3-a7912a5d5e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.228036 Sep 15 09:08:09.495143 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 587/1115] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:09 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:10.517162 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:10.517672 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:10.524793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:10.525226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:10.525971 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:10.526421 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:10.740784 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:10.749391 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4e30635b-ddb8-47ef-9167-d5ae6c9d9a06 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.241404 Sep 15 09:08:10.749921 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 529/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:10 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:11.771360 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:11.771940 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:11.779086 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:11.780049 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:11.780816 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:11.781236 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:11.985985 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:11.994584 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4cc6372d-3ccd-48fa-bdf5-172724459f91 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.232530 Sep 15 09:08:11.995110 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 588/1117] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:11 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:13.017236 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:13.017822 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:13.025408 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:13.025850 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:13.026645 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:13.027070 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:13.236654 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:13.245409 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d8d3f61b-bbc6-4476-9281-dbdb9dfb0d0b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.237264 Sep 15 09:08:13.245935 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 530/1118] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:13 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:14.268927 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:14.269529 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:14.276749 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:14.277191 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:14.277946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:14.278404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:14.476880 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:14.485732 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5f2e0575-52c6-4048-ba0d-afee75e4741b tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.226510 Sep 15 09:08:14.486271 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 589/1119] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:14 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:15.508340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:15.508923 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:15.516563 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:15.517003 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:15.517760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:15.518222 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:15.718146 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:15.726529 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e45bcb58-9eaa-41bc-bb17-acc9ef82c669 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.227196 Sep 15 09:08:15.727043 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 531/1120] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:15 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:16.748768 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:16.749372 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:16.756541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:16.756980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:16.757731 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:16.758215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:16.960643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:16.969547 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2db343bb-8f65-47e8-910e-9e1252c812ff tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.230224 Sep 15 09:08:16.970066 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 590/1121] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:16 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:17.991922 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:17.992525 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:18.000682 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:18.001126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:18.001882 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:18.002338 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:18.204571 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:18.212967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-32b44998-7e93-4a1b-8414-62fbd6b7eef0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.230376 Sep 15 09:08:18.213483 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 532/1122] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:17 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:19.236645 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:19.237245 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:19.244732 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:19.245169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:19.245918 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:19.246364 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:19.446759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:19.455202 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8feb2654-0a77-43e9-a099-206679601bb0 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.228336 Sep 15 09:08:19.455734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 591/1123] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:19 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:20.477055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:20.477589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:20.485376 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:20.485826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:20.486638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:20.487072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:20.694827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:20.703302 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-58aeecd7-a012-4019-8824-67cc0397219f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1756 microversion: 2.1 time: 0.235371 Sep 15 09:08:20.703827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 533/1124] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:20 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:21.725435 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:21.726050 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:21.733253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:21.733735 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:21.734532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:21.734967 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:21.941591 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:08:21.949934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8e6027bb-33dd-40a9-8950-e3302030f298 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1759 microversion: 2.1 time: 0.233759 Sep 15 09:08:21.950477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 592/1125] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:08:21 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:08:53.622726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-404538341"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:08:53.623341 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:53.626174 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:08:53.626316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:08:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/action (ip 10.222.0.39) !!! Sep 15 09:08:53.643020 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:53.643453 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:53.644214 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:53.644632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:53.914824 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.network.security_group_api [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Removing security group 25ccf4df-fde4-40c2-af84-6aa333d4b1b3 from port 68444aa9-d7ab-46c3-a964-8060a8a46688 Sep 15 09:08:54.435565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-eb6e46a3-3143-497a-9c9a-f463d6be1a6d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/action" status: 202 len: 0 microversion: 2.1 time: 0.822323 Sep 15 09:08:54.436432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 534/1126] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:08:53 2021] POST /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:08:54.548460 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-23d6f803-8e95-411c-a836-7cec15f22662 req-fa3142d3-3a4f-4c3f-83ed-d3d570a1795f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4df0363-1513-4e8f-b334-57c308931090", "tag": "68444aa9-d7ab-46c3-a964-8060a8a46688"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:08:54.556685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:08:54.556685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:08:54.571164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-23d6f803-8e95-411c-a836-7cec15f22662 req-fa3142d3-3a4f-4c3f-83ed-d3d570a1795f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:54.571934 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-23d6f803-8e95-411c-a836-7cec15f22662 req-fa3142d3-3a4f-4c3f-83ed-d3d570a1795f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:54.588016 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-23d6f803-8e95-411c-a836-7cec15f22662 req-fa3142d3-3a4f-4c3f-83ed-d3d570a1795f service nova] Creating event network-changed:68444aa9-d7ab-46c3-a964-8060a8a46688 for instance e4df0363-1513-4e8f-b334-57c308931090 on hv-cinder-80600 Sep 15 09:08:54.594508 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-23d6f803-8e95-411c-a836-7cec15f22662 req-fa3142d3-3a4f-4c3f-83ed-d3d570a1795f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153261 Sep 15 09:08:54.595700 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 593/1127] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:08:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:08:56.874936 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-09f79d66-fed7-448c-ab0c-8e91cf12a2d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:56.876097 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-09f79d66-fed7-448c-ab0c-8e91cf12a2d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:56.876430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-8475239e-b366-422c-b3f0-3048ee2d682d req-29484f4b-de52-4c2c-99c3-29692d2208e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4df0363-1513-4e8f-b334-57c308931090", "tag": "68444aa9-d7ab-46c3-a964-8060a8a46688"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:08:56.882805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:08:56.882805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:08:56.883969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09f79d66-fed7-448c-ab0c-8e91cf12a2d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:56.884480 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09f79d66-fed7-448c-ab0c-8e91cf12a2d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:56.885324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09f79d66-fed7-448c-ab0c-8e91cf12a2d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:56.885828 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-09f79d66-fed7-448c-ab0c-8e91cf12a2d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:56.891861 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-8475239e-b366-422c-b3f0-3048ee2d682d req-29484f4b-de52-4c2c-99c3-29692d2208e9 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:56.893776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-8475239e-b366-422c-b3f0-3048ee2d682d req-29484f4b-de52-4c2c-99c3-29692d2208e9 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:56.908914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-8475239e-b366-422c-b3f0-3048ee2d682d req-29484f4b-de52-4c2c-99c3-29692d2208e9 service nova] Creating event network-changed:68444aa9-d7ab-46c3-a964-8060a8a46688 for instance e4df0363-1513-4e8f-b334-57c308931090 on hv-cinder-80600 Sep 15 09:08:56.914348 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-8475239e-b366-422c-b3f0-3048ee2d682d req-29484f4b-de52-4c2c-99c3-29692d2208e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047731 Sep 15 09:08:56.915322 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 594/1128] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:08:57.272539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-09f79d66-fed7-448c-ab0c-8e91cf12a2d3 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments/e3e83977-c904-48f5-9e27-3931379fdbb3" status: 202 len: 0 microversion: 2.1 time: 0.408035 Sep 15 09:08:57.277233 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 535/1129] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:08:56 2021] DELETE /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments/e3e83977-c904-48f5-9e27-3931379fdbb3 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:08:57.288637 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-461681a1-138b-4646-9242-f1ac2d9db53f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:57.292998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-461681a1-138b-4646-9242-f1ac2d9db53f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:57.298637 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-461681a1-138b-4646-9242-f1ac2d9db53f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:57.299168 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-461681a1-138b-4646-9242-f1ac2d9db53f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:57.300187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-461681a1-138b-4646-9242-f1ac2d9db53f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:57.300592 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-461681a1-138b-4646-9242-f1ac2d9db53f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:57.374409 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-461681a1-138b-4646-9242-f1ac2d9db53f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096560 Sep 15 09:08:57.375399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 595/1130] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:08:57 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:08:58.398997 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-9d7a34cc-6603-4afb-8e32-3c86626f987d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:58.399997 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-9d7a34cc-6603-4afb-8e32-3c86626f987d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:58.407478 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9d7a34cc-6603-4afb-8e32-3c86626f987d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:58.407927 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9d7a34cc-6603-4afb-8e32-3c86626f987d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:58.408716 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9d7a34cc-6603-4afb-8e32-3c86626f987d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:58.409144 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-9d7a34cc-6603-4afb-8e32-3c86626f987d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:58.477636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-9d7a34cc-6603-4afb-8e32-3c86626f987d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089088 Sep 15 09:08:58.478200 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 536/1131] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:08:58 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:08:59.494392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2b29612c-6ba3-4deb-9b66-93de334234d6 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:59.495216 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2b29612c-6ba3-4deb-9b66-93de334234d6 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:59.502426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b29612c-6ba3-4deb-9b66-93de334234d6 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:59.502870 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b29612c-6ba3-4deb-9b66-93de334234d6 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:59.503626 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b29612c-6ba3-4deb-9b66-93de334234d6 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:59.504056 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b29612c-6ba3-4deb-9b66-93de334234d6 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:59.573092 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2b29612c-6ba3-4deb-9b66-93de334234d6 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088230 Sep 15 09:08:59.573632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 596/1132] 10.222.0.39 () {58 vars in 1302 bytes} [Wed Sep 15 09:08:59 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 09:08:59.589012 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:08:59.589527 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:08:59.597276 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:59.597717 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:59.598513 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:08:59.598946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:08:59.754022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] HTTP exception thrown: Instance e4df0363-1513-4e8f-b334-57c308931090 is not attached to volume e3e83977-c904-48f5-9e27-3931379fdbb3 Sep 15 09:08:59.754641 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Returning 404 to user: Instance e4df0363-1513-4e8f-b334-57c308931090 is not attached to volume e3e83977-c904-48f5-9e27-3931379fdbb3 {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:08:59.755465 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b1b2eba4-4024-44d2-afdd-1afb64c4a2ee tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments/e3e83977-c904-48f5-9e27-3931379fdbb3" status: 404 len: 154 microversion: 2.1 time: 0.175744 Sep 15 09:08:59.755998 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 537/1133] 10.222.0.39 () {58 vars in 1416 bytes} [Wed Sep 15 09:08:59 2021] DELETE /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090/os-volume_attachments/e3e83977-c904-48f5-9e27-3931379fdbb3 => generated 154 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:09:01.157017 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:09:01.157542 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:09:01.164699 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:01.165137 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:01.165886 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:01.166345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:01.229441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:09:01.507777 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f02a9ed3-5372-43e3-9052-734a6d7d643d tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 204 len: 0 microversion: 2.1 time: 0.360001 Sep 15 09:09:01.508271 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 597/1134] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:09:01 2021] DELETE /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:09:01.522113 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:09:01.522722 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:09:01.530316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:01.530829 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:01.531622 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:01.532118 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:01.791048 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:09:01.799860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-601774db-409d-42d4-b750-4ecef37413b9 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1554 microversion: 2.1 time: 0.287392 Sep 15 09:09:01.800385 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 538/1135] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:09:01 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:09:02.823355 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:09:02.824052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:09:02.831802 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:02.832240 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:02.832995 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:02.833422 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:03.133741 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:09:03.141891 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5e845af9-5ffb-4c68-aefa-8115acaca75f tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1554 microversion: 2.1 time: 0.328274 Sep 15 09:09:03.142452 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 598/1136] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:09:02 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1554 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:09:04.165642 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:09:04.166285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:09:04.174723 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:04.180732 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:04.180732 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:04.180732 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:04.235695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-4989b348-5f4e-441f-b073-4252a6b664ee req-d7039d11-7ea4-4c94-8434-daeaf5bffcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4df0363-1513-4e8f-b334-57c308931090", "name": "network-vif-deleted", "tag": "68444aa9-d7ab-46c3-a964-8060a8a46688"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:09:04.242284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:09:04.242284 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:09:04.250948 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-4989b348-5f4e-441f-b073-4252a6b664ee req-d7039d11-7ea4-4c94-8434-daeaf5bffcb2 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:04.251390 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-4989b348-5f4e-441f-b073-4252a6b664ee req-d7039d11-7ea4-4c94-8434-daeaf5bffcb2 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:04.268085 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-4989b348-5f4e-441f-b073-4252a6b664ee req-d7039d11-7ea4-4c94-8434-daeaf5bffcb2 service nova] Creating event network-vif-deleted:68444aa9-d7ab-46c3-a964-8060a8a46688 for instance e4df0363-1513-4e8f-b334-57c308931090 on hv-cinder-80600 Sep 15 09:09:04.272976 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-4989b348-5f4e-441f-b073-4252a6b664ee req-d7039d11-7ea4-4c94-8434-daeaf5bffcb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046517 Sep 15 09:09:04.273632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 599/1137] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:09:04.374010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee468ff40b1741b1af37adb558a0517b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c8fbe80a454d26895eb9dd55dbfa6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:09:04.382198 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e1b8e671-3deb-44c2-ac52-4aad40471e81 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 200 len: 1512 microversion: 2.1 time: 0.227586 Sep 15 09:09:04.382733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 539/1138] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:09:04 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:09:05.409568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:09:05.499565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] [instance: e4df0363-1513-4e8f-b334-57c308931090] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:09:05.499565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:05.499565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:05.499565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:05.500015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:05.500015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] HTTP exception thrown: Instance e4df0363-1513-4e8f-b334-57c308931090 could not be found. Sep 15 09:09:05.500015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Returning 404 to user: Instance e4df0363-1513-4e8f-b334-57c308931090 could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:09:05.500015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-db456126-4819-42a8-a15e-dbb3c3acd748 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090" status: 404 len: 111 microversion: 2.1 time: 0.074918 Sep 15 09:09:05.500015 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 600/1139] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:09:05 2021] GET /compute/v2.1/servers/e4df0363-1513-4e8f-b334-57c308931090 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:09:05.500445 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-da8d2609-7009-4feb-9f01-fe25d05b8454 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] Calling method '.version_select at 0x7f1ec67d2c10>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:09:05.621713 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-da8d2609-7009-4feb-9f01-fe25d05b8454 tempest-TestMinimumBasicScenario-1759648097 tempest-TestMinimumBasicScenario-1759648097-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1840160698" status: 202 len: 0 microversion: 2.1 time: 0.142706 Sep 15 09:09:05.622294 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 540/1140] 10.222.0.39 () {58 vars in 1272 bytes} [Wed Sep 15 09:09:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1840160698 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:09:35.905391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Action: 'create', calling method: .version_select at 0x7f1ec67fce50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1146806295"}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:09:35.931789 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Getting quotas for project 74f152a04b0f4546ba63efd155a1d010. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:09:35.935658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Getting quotas for user 70c39097c348466fab8594c9833ab11f and project 74f152a04b0f4546ba63efd155a1d010. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:09:35.947132 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [0b61d094-51a4-4448-a304-483b347e714b] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 09:09:36.963727 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [0b61d094-51a4-4448-a304-483b347e714b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46820. Sep 15 09:09:37.457231 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Getting quotas for project 74f152a04b0f4546ba63efd155a1d010. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:09:37.460766 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Getting quotas for user 70c39097c348466fab8594c9833ab11f and project 74f152a04b0f4546ba63efd155a1d010. Resources: {'key_pairs'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:09:37.472840 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cfc771a9-19e5-4a98-bcdb-c107c4f265a1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.772577 Sep 15 09:09:37.473415 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 601/1141] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Sep 15 09:09:35 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:09:57.173016 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-489378574", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1146806295", "security_groups": [{"name": "tempest-secgroup-smoke-1687753449"}], "networks": [{"uuid": "ef5b8ba3-e98e-49bd-8fa5-ec47156abc58"}], "block_device_mapping_v2": [{"uuid": "c98dc226-da47-425e-afc6-2561bf6783bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:09:57.421209 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] validate_networks() for [('ef5b8ba3-e98e-49bd-8fa5-ec47156abc58', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:09:58.414395 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:09:58.414908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:09:58.415270 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:09:58.415669 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:09:58.416072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:09:58.424994 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:58.425427 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:58.426249 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:09:58.426675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:09:58.443473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Getting quotas for project 74f152a04b0f4546ba63efd155a1d010. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:09:58.447411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Getting quotas for user 70c39097c348466fab8594c9833ab11f and project 74f152a04b0f4546ba63efd155a1d010. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:09:58.543451 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:09:58.545572 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c98dc226-da47-425e-afc6-2561bf6783bd',volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:09:58.940708 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5743d8ca-32a9-493e-930e-46b58a25a8e4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.777426 Sep 15 09:09:58.941339 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 541/1142] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:09:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 09:09:58.957440 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-699e65c7-4049-4d0d-8544-16c3b854ff3c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:09:58.961308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-699e65c7-4049-4d0d-8544-16c3b854ff3c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:09:59.036817 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-699e65c7-4049-4d0d-8544-16c3b854ff3c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:09:59.044210 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-699e65c7-4049-4d0d-8544-16c3b854ff3c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1088 microversion: 2.1 time: 0.096602 Sep 15 09:09:59.047159 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 602/1143] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:09:58 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1088 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:00.066139 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c28a1dd4-18c8-4661-a0e7-5b332d750347 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:00.066724 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c28a1dd4-18c8-4661-a0e7-5b332d750347 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:00.144632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c28a1dd4-18c8-4661-a0e7-5b332d750347 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:00.151917 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c28a1dd4-18c8-4661-a0e7-5b332d750347 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1088 microversion: 2.1 time: 0.095060 Sep 15 09:10:00.159033 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 542/1144] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:00 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:01.175010 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:01.175650 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:01.183528 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:01.185221 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:01.185221 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:01.185221 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:01.302725 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:01.311020 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-4339f56f-eeec-440a-afc3-15e73589efbd tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1186 microversion: 2.1 time: 0.145820 Sep 15 09:10:01.317823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 603/1145] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:01 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1186 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:02.335935 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:02.336547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:02.344435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:02.344875 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:02.345892 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:02.346357 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:02.797047 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:02.805771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-94209176-93d2-4867-bf7a-34baf499a4ef tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1272 microversion: 2.1 time: 0.482067 Sep 15 09:10:02.815472 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 543/1146] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:02 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1272 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:03.728326 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-1f7f5d11-4418-46b3-9547-f03f6c0fcf61 req-478085fb-10ae-4cc5-beb2-4232e41ef94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce030c4-8a29-4653-b255-23c5b87cccd7", "tag": "0386354f-7082-4534-9f1c-297e41cf9ca3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:10:03.735511 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:10:03.735511 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:10:03.744160 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-1f7f5d11-4418-46b3-9547-f03f6c0fcf61 req-478085fb-10ae-4cc5-beb2-4232e41ef94c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:03.744602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-1f7f5d11-4418-46b3-9547-f03f6c0fcf61 req-478085fb-10ae-4cc5-beb2-4232e41ef94c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:03.761603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-1f7f5d11-4418-46b3-9547-f03f6c0fcf61 req-478085fb-10ae-4cc5-beb2-4232e41ef94c service nova] Creating event network-changed:0386354f-7082-4534-9f1c-297e41cf9ca3 for instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 on hv-cinder-80600 Sep 15 09:10:03.766441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-1f7f5d11-4418-46b3-9547-f03f6c0fcf61 req-478085fb-10ae-4cc5-beb2-4232e41ef94c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050307 Sep 15 09:10:03.767029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 604/1147] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:10:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:10:03.828244 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:03.829456 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:03.836990 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:03.837435 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:03.838510 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:03.839111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:04.234963 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:04.243636 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3b812040-23f7-4a54-baeb-82f871122564 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.424652 Sep 15 09:10:04.244172 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 544/1148] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:03 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:05.266469 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:05.267156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:05.274535 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:05.274980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:05.275737 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:05.276164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:05.478921 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:05.487428 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ce364193-118e-4573-9b27-8efb302a5315 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.230645 Sep 15 09:10:05.487953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 605/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:05 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:06.509831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:06.510457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:06.518308 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:06.518756 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:06.519507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:06.519929 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:06.716674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:06.724616 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-39ba364f-3618-4c07-ab84-4f50e6a92d5d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.223854 Sep 15 09:10:06.725146 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 545/1150] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:06 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:07.746289 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:07.746895 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:07.750167 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 09:10:07.755032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:07.755471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:07.756233 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:07.756659 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:07.953923 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:07.961823 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ab9b646b-3b90-4bfe-a6c0-9819f64f4e2c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.225025 Sep 15 09:10:07.962372 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 606/1151] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:07 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:08.984518 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:08.985100 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:08.992672 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:08.993103 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:08.993848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:08.994303 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:09.288490 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:09.296467 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-65e89009-384b-45ab-9186-74386c8015f6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.321824 Sep 15 09:10:09.296984 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 546/1152] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:08 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:10.318742 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:10.319340 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:10.336772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:10.337211 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:10.337965 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:10.338416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:10.371854 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46956. Sep 15 09:10:10.539755 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:10.547662 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-aa8c1eba-0d1a-413e-9de7-86ea6a7f4c1a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.238707 Sep 15 09:10:10.548179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 607/1153] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:10 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:11.569011 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:11.569594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:11.576642 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:11.577570 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:11.578345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:11.578763 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:11.779551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:11.787474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4ce19645-957d-48e1-8353-8006b1bfdd75 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.227570 Sep 15 09:10:11.787994 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 547/1154] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:11 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:12.809093 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:12.809695 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:12.816756 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:12.817370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:12.818156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:12.818583 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:13.024194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:13.032833 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8474b5e5-dbbb-45fb-900e-9524548caa1f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.232858 Sep 15 09:10:13.033377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 608/1155] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:12 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:14.055289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:14.055909 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:14.063161 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:14.063594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:14.064345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:14.064766 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:14.263707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:14.272119 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-75fe7450-d139-4487-97bf-24a7475fdebf tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.226618 Sep 15 09:10:14.272631 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 548/1156] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:14 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:14.538411 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-e0e2b564-70ca-4b5c-8910-952cc3de85ee req-312208ee-bd3d-4345-bd94-0570f5b3ea11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce030c4-8a29-4653-b255-23c5b87cccd7", "name": "network-vif-plugged", "status": "completed", "tag": "0386354f-7082-4534-9f1c-297e41cf9ca3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:10:14.544754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:10:14.544754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:10:14.552878 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-e0e2b564-70ca-4b5c-8910-952cc3de85ee req-312208ee-bd3d-4345-bd94-0570f5b3ea11 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:14.553591 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-e0e2b564-70ca-4b5c-8910-952cc3de85ee req-312208ee-bd3d-4345-bd94-0570f5b3ea11 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:14.569831 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-e0e2b564-70ca-4b5c-8910-952cc3de85ee req-312208ee-bd3d-4345-bd94-0570f5b3ea11 service nova] Creating event network-vif-plugged:0386354f-7082-4534-9f1c-297e41cf9ca3 for instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 on hv-cinder-80600 Sep 15 09:10:14.574878 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-e0e2b564-70ca-4b5c-8910-952cc3de85ee req-312208ee-bd3d-4345-bd94-0570f5b3ea11 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119579 Sep 15 09:10:14.575758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 609/1157] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:10:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:10:15.294547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:15.295081 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:15.302780 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:15.303225 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:15.303983 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:15.304411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:15.503968 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:15.511846 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ed592ba7-3768-409f-94e4-79b3caf98486 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1260 microversion: 2.1 time: 0.226617 Sep 15 09:10:15.512368 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 549/1158] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:15 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:16.533648 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:16.534392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:16.541729 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:16.542208 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:16.542967 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:16.543397 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:16.747239 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:16.756312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c9b65e82-60c6-43dc-a2ab-b74df95c338e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1444 microversion: 2.1 time: 0.232389 Sep 15 09:10:16.756838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 610/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:16 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1444 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:16.777206 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:10:16.777804 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:10:16.784850 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:16.785295 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:16.786053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:16.786507 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:16.991078 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:10:16.999201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-3f01deee-ec5d-4ab3-98db-a7aa0df95ec6 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1444 microversion: 2.1 time: 0.230899 Sep 15 09:10:16.999745 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 550/1160] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:10:16 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1444 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:10:19.901654 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-3c26dfad-1d50-4e50-98dd-f230a2f92646 req-8f193373-6580-46ef-9c91-3a750a2df5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce030c4-8a29-4653-b255-23c5b87cccd7", "tag": "0386354f-7082-4534-9f1c-297e41cf9ca3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:10:19.908387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:10:19.908387 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:10:19.916946 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-3c26dfad-1d50-4e50-98dd-f230a2f92646 req-8f193373-6580-46ef-9c91-3a750a2df5b7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:10:19.917777 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-3c26dfad-1d50-4e50-98dd-f230a2f92646 req-8f193373-6580-46ef-9c91-3a750a2df5b7 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:10:19.934444 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-3c26dfad-1d50-4e50-98dd-f230a2f92646 req-8f193373-6580-46ef-9c91-3a750a2df5b7 service nova] Creating event network-changed:0386354f-7082-4534-9f1c-297e41cf9ca3 for instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 on hv-cinder-80600 Sep 15 09:10:19.939932 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-3c26dfad-1d50-4e50-98dd-f230a2f92646 req-8f193373-6580-46ef-9c91-3a750a2df5b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128181 Sep 15 09:10:19.940571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 611/1161] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:10:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:12:14.135865 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:12:14.136486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:14.139781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 09:12:14.140574 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 09:12:14.140712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:12:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7/action (ip 10.222.0.39) !!! Sep 15 09:12:14.151267 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 09:12:14.151411 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:12:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7/action (ip 10.222.0.39) !!! Sep 15 09:12:14.161280 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 09:12:14.161406 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:12:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7/action (ip 10.222.0.39) !!! Sep 15 09:12:14.179961 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:14.180404 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:14.181173 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:14.181771 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:14.244560 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.objects.instance [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lazy-loading 'flavor' on Instance uuid 7ce030c4-8a29-4653-b255-23c5b87cccd7 {{(pid=89583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:12:14.529375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-e7433692-b499-400e-9cf2-375c181afee1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "POST /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7/action" status: 202 len: 0 microversion: 2.1 time: 0.402900 Sep 15 09:12:14.530010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 551/1162] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:12:14 2021] POST /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:12:14.536329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:12:14.536834 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:12:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 (ip 10.222.0.39) !!! Sep 15 09:12:14.547394 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] AMQP server on 10.222.0.39:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 15 09:12:14.557641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:14.558364 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:14.567661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:14.568104 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:14.568866 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:14.569295 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:14.769530 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:14.777676 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-bce2e741-0f10-426a-9e23-5f615aa41be8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.242975 Sep 15 09:12:14.778235 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 612/1163] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:14 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:15.800972 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:15.801647 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:15.823068 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:15.823577 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:15.824353 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:15.824780 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:15.852395 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47028. Sep 15 09:12:16.029434 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:16.037489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-02682f57-0838-413a-b179-1110d54635a8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.246042 Sep 15 09:12:16.038022 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 552/1164] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:15 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:17.060107 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:17.060717 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:17.079356 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:17.079877 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:17.080676 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:17.081112 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:17.132792 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47032. Sep 15 09:12:17.288002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:17.296439 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dee69c91-93c3-4150-b3c2-bea9f56c2e37 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.246297 Sep 15 09:12:17.296951 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 613/1165] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:17 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:18.318810 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:18.319413 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:18.327288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:18.327728 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:18.328484 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:18.328911 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:18.526252 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:18.534333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-66200aa8-32d8-4b89-9214-59101e569b7c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.224758 Sep 15 09:12:18.534863 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 553/1166] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:18 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:19.556513 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:19.557107 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:19.564352 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:19.564785 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:19.565541 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:19.565962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:19.765451 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:19.773475 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ee695598-b666-4b6c-8993-28c41e62f320 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.226156 Sep 15 09:12:19.776584 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 614/1167] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:19 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:20.796879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:20.797421 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:20.804642 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:20.805086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:20.805848 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:20.806307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:21.007324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:21.015869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4ebdf537-561f-4ba1-977f-253c392cc789 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.228876 Sep 15 09:12:21.016405 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 554/1168] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:20 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:22.037808 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:22.038449 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:22.046358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:22.046835 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:22.047600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:22.048029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:22.331734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:22.340179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-21ce869a-e4c3-4c79-bf0d-8c765dba220b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.311542 Sep 15 09:12:22.340707 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 615/1169] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:22 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:23.362728 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:23.363322 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:23.371585 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:23.373823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:23.373823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:23.373823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:23.571674 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:23.579595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ea7567a3-3771-4e9a-bd24-44af3ac81a71 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.226664 Sep 15 09:12:23.580111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 555/1170] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:23 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:24.601872 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:24.602496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:24.609602 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:24.610035 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:24.610806 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:24.611227 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:24.809997 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:24.817911 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1d2207e0-e8ef-4b51-93bd-5ab22925d854 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.225106 Sep 15 09:12:24.818470 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 616/1171] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:24 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:25.838955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:25.839538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:25.846616 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:25.847059 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:25.847823 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:25.848251 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:26.047320 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:26.055324 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-78b35046-6c1b-4628-83b5-e040c5d393d4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.225490 Sep 15 09:12:26.056331 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 556/1172] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:25 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:27.078384 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:27.078984 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:27.086135 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:27.086755 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:27.087970 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:27.088400 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:27.286044 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:27.293976 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f23a2e52-f3c8-4264-9cfc-b5e99abe00fb tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.225282 Sep 15 09:12:27.294562 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 617/1173] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:27 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:28.316339 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:28.317669 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:28.323992 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:28.324430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:28.325188 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:28.325614 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:28.528101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:28.536184 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-6655bf94-7813-48eb-87ba-66d02cfda936 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1569 microversion: 2.1 time: 0.229066 Sep 15 09:12:28.536695 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 557/1174] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:28 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:28.557453 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fbe69a8b-7fdf-4601-8367-1edbd00d508b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:12:28.558025 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fbe69a8b-7fdf-4601-8367-1edbd00d508b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:28.565153 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fbe69a8b-7fdf-4601-8367-1edbd00d508b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:28.565596 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fbe69a8b-7fdf-4601-8367-1edbd00d508b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:28.566453 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fbe69a8b-7fdf-4601-8367-1edbd00d508b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:28.566825 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fbe69a8b-7fdf-4601-8367-1edbd00d508b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:29.029688 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fbe69a8b-7fdf-4601-8367-1edbd00d508b tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "POST /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7/action" status: 202 len: 0 microversion: 2.1 time: 0.480779 Sep 15 09:12:29.030855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 618/1175] 10.222.0.39 () {60 vars in 1278 bytes} [Wed Sep 15 09:12:28 2021] POST /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:12:29.044301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:29.044831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:29.052091 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:29.052534 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:29.053304 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:29.053734 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:29.315835 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:29.323826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c7eeb8c2-2b0f-4705-8773-53fc5781af04 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1517 microversion: 2.1 time: 0.288978 Sep 15 09:12:29.324456 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 558/1176] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:29 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:30.345648 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:30.346215 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:30.353266 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:30.353713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:30.354513 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:30.354953 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:30.551914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:30.560477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-85fb1bc9-7e86-45e2-999a-008b4666f90d tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1519 microversion: 2.1 time: 0.224027 Sep 15 09:12:30.566271 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 619/1177] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:30 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:31.110798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-bcb1ca60-0c67-4768-8268-cf41c6523b8a req-ecaa861f-72f3-4cc9-852b-b16bf7fe1d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce030c4-8a29-4653-b255-23c5b87cccd7", "name": "network-vif-unplugged", "status": "completed", "tag": "0386354f-7082-4534-9f1c-297e41cf9ca3"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:12:31.117714 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:12:31.117714 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:12:31.126187 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-bcb1ca60-0c67-4768-8268-cf41c6523b8a req-ecaa861f-72f3-4cc9-852b-b16bf7fe1d55 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:31.127725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-bcb1ca60-0c67-4768-8268-cf41c6523b8a req-ecaa861f-72f3-4cc9-852b-b16bf7fe1d55 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:31.145086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.compute.server_external_events [req-bcb1ca60-0c67-4768-8268-cf41c6523b8a req-ecaa861f-72f3-4cc9-852b-b16bf7fe1d55 service nova] Unable to find a host for instance 7ce030c4-8a29-4653-b255-23c5b87cccd7. Dropping event network-vif-unplugged {{(pid=89583) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 15 09:12:31.145953 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-bcb1ca60-0c67-4768-8268-cf41c6523b8a req-ecaa861f-72f3-4cc9-852b-b16bf7fe1d55 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047313 Sep 15 09:12:31.147070 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 559/1178] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 15 09:12:31.585476 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:31.586146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:31.593614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:31.594052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:31.594833 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:31.595254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:31.798200 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:31.806596 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5d4f2630-f1dc-4733-a37e-521d4530382a tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1519 microversion: 2.1 time: 0.230864 Sep 15 09:12:31.807118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 620/1179] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:31 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:32.828893 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:32.829491 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:32.837230 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:32.837675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:32.838471 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:32.838901 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:33.041193 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:33.049226 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-71bf064f-2661-43ca-bbb6-693232d0a1ec tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.229476 Sep 15 09:12:33.049778 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 560/1180] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:32 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:34.071335 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:34.071929 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:34.079054 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:34.079498 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:34.080253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:34.080681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:34.290332 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:34.298255 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-49994e1f-525c-459f-81cc-5b6af48b7812 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.235994 Sep 15 09:12:34.298790 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 621/1181] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:34 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:12:35.320165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:35.320758 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:35.327958 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:35.328393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:35.329140 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:35.329559 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:35.532726 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:35.541317 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b4c5b464-3a9e-4d6a-a77e-65aca2639a1e tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.230184 Sep 15 09:12:35.541831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 561/1182] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:35 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:36.563461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:36.564065 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:36.571254 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:36.571697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:36.572457 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:36.572882 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:36.770237 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:36.778854 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-34ae94eb-5722-47de-b5c0-9f451bd2f1c1 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.224582 Sep 15 09:12:36.779377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 622/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:36 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:37.801339 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:37.801933 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:37.809101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:37.809538 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:37.810318 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:37.810743 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:38.005796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:38.013744 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-dfbda62d-f86d-46d5-ae02-7b50cf722618 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.221311 Sep 15 09:12:38.014281 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 562/1184] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:37 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:39.035320 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:39.035910 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:39.043658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:39.044097 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:39.044851 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:39.045276 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:39.246078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:39.254106 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d19f211f-66a8-46a1-875d-560e833e1dc4 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.227897 Sep 15 09:12:39.254641 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 623/1185] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:39 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:40.276140 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:40.276743 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:40.283915 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:40.284358 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:40.285123 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:40.285552 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:40.485392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:40.494491 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-29dd5a3f-3c01-4e8e-87b1-b16b0203ddf0 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.227431 Sep 15 09:12:40.495008 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 563/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:40 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:41.517146 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:41.517675 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:41.525477 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:41.525913 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:41.526697 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:41.527124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:41.727076 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:41.735329 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-b880ce0c-29f3-4dea-bd14-34cb0a3855e8 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.228052 Sep 15 09:12:41.735871 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 624/1187] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:41 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:42.759969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:42.760567 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:42.767826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:42.768197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:42.768941 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:42.769357 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:42.967639 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:42.975545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-93749925-e6db-42db-8f96-e37e3c9cd053 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.224485 Sep 15 09:12:42.976063 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 564/1188] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:42 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:43.248824 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-3963bd56-0b4b-49ab-b7d5-d30d34816bd0 req-c54dcd7c-1611-4082-a51f-accbc1986c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce030c4-8a29-4653-b255-23c5b87cccd7", "name": "network-vif-plugged", "status": "completed", "tag": "0386354f-7082-4534-9f1c-297e41cf9ca3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:12:43.255314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:12:43.255314 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:12:43.263396 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-3963bd56-0b4b-49ab-b7d5-d30d34816bd0 req-c54dcd7c-1611-4082-a51f-accbc1986c83 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:43.263839 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-3963bd56-0b4b-49ab-b7d5-d30d34816bd0 req-c54dcd7c-1611-4082-a51f-accbc1986c83 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:43.279879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-3963bd56-0b4b-49ab-b7d5-d30d34816bd0 req-c54dcd7c-1611-4082-a51f-accbc1986c83 service nova] Creating event network-vif-plugged:0386354f-7082-4534-9f1c-297e41cf9ca3 for instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 on hv-cinder-80600 Sep 15 09:12:43.283054 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [req-3963bd56-0b4b-49ab-b7d5-d30d34816bd0 req-c54dcd7c-1611-4082-a51f-accbc1986c83 service nova] [4b40b18b-3120-4fad-8192-959bd1825b77] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 09:12:43.998663 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:43.999254 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:44.006440 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:44.006881 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:44.007638 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:44.008729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:44.210555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:44.218654 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d1e44af7-3373-4b51-adf3-315f09a4f755 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.229554 Sep 15 09:12:44.219177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 565/1189] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:43 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:44.299867 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [req-3963bd56-0b4b-49ab-b7d5-d30d34816bd0 req-c54dcd7c-1611-4082-a51f-accbc1986c83 service nova] [4b40b18b-3120-4fad-8192-959bd1825b77] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47094. Sep 15 09:12:44.303325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-3963bd56-0b4b-49ab-b7d5-d30d34816bd0 req-c54dcd7c-1611-4082-a51f-accbc1986c83 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.063879 Sep 15 09:12:44.303904 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 625/1190] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:12:45.241001 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:45.241597 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:45.248880 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:45.249318 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:45.250073 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:45.250535 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:45.559679 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:45.567930 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4a5f4916-bfb4-41fc-a340-af77b0b14ed5 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1575 microversion: 2.1 time: 0.336236 Sep 15 09:12:45.568453 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 566/1191] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:45 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1575 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:12:46.591086 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:12:46.591771 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:12:46.599177 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:46.599616 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:46.600370 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:12:46.600797 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:12:46.801109 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:12:46.809770 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ca16168f-4f57-4767-a691-fc7eb0b1d296 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1562 microversion: 2.1 time: 0.228930 Sep 15 09:12:46.810345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 626/1192] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:12:46 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:14:04.169728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-6028a1f4-edc6-42b2-819d-4340093c4108 req-27a97728-50d4-4cd4-a413-e5a40a839710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce030c4-8a29-4653-b255-23c5b87cccd7", "tag": "0386354f-7082-4534-9f1c-297e41cf9ca3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:14:04.174216 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:04.175166 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:14:04.177721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:14:04.177721 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:14:04.186957 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:04.187374 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:14:04.187556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:04.187671 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:14:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Sep 15 09:14:04.188466 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:04.188954 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:04.203600 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-6028a1f4-edc6-42b2-819d-4340093c4108 req-27a97728-50d4-4cd4-a413-e5a40a839710 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:04.204037 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-6028a1f4-edc6-42b2-819d-4340093c4108 req-27a97728-50d4-4cd4-a413-e5a40a839710 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:04.222879 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-6028a1f4-edc6-42b2-819d-4340093c4108 req-27a97728-50d4-4cd4-a413-e5a40a839710 service nova] Creating event network-changed:0386354f-7082-4534-9f1c-297e41cf9ca3 for instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 on hv-cinder-80600 Sep 15 09:14:04.228681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-6028a1f4-edc6-42b2-819d-4340093c4108 req-27a97728-50d4-4cd4-a413-e5a40a839710 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069293 Sep 15 09:14:04.229802 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 627/1193] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:14:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:14:04.272217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:14:04.571697 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-0ceda0d1-5c11-4235-aa5f-5cfb6a7fee55 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 204 len: 0 microversion: 2.1 time: 0.413597 Sep 15 09:14:04.577733 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 567/1194] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:14:04 2021] DELETE /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:14:04.587303 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:04.587996 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:14:04.595637 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:04.596084 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:04.597032 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:04.597349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:04.971607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:14:04.980468 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0591cd7d-f340-43d2-a673-4cc910b9951f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1568 microversion: 2.1 time: 0.403266 Sep 15 09:14:04.991838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 628/1195] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:14:04 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1568 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:14:06.005393 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:06.006068 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:14:06.013272 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:06.013725 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:06.014535 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:06.014967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:06.359165 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:14:06.368055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-641e381c-4f89-4427-ba1b-d217aee8e2d7 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1450 microversion: 2.1 time: 0.372852 Sep 15 09:14:06.368594 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 568/1196] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:14:05 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1450 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:14:07.202388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-ccf63865-6613-46fa-95aa-5f19c74eca2a req-5c8c4e0c-83e3-4f48-a090-9b95ba01d27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce030c4-8a29-4653-b255-23c5b87cccd7", "name": "network-vif-deleted", "tag": "0386354f-7082-4534-9f1c-297e41cf9ca3"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:14:07.209767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:14:07.209767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:14:07.217924 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-ccf63865-6613-46fa-95aa-5f19c74eca2a req-5c8c4e0c-83e3-4f48-a090-9b95ba01d27e service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:07.218388 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-ccf63865-6613-46fa-95aa-5f19c74eca2a req-5c8c4e0c-83e3-4f48-a090-9b95ba01d27e service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:07.234792 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-ccf63865-6613-46fa-95aa-5f19c74eca2a req-5c8c4e0c-83e3-4f48-a090-9b95ba01d27e service nova] Creating event network-vif-deleted:0386354f-7082-4534-9f1c-297e41cf9ca3 for instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 on hv-cinder-80600 Sep 15 09:14:07.239683 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-ccf63865-6613-46fa-95aa-5f19c74eca2a req-5c8c4e0c-83e3-4f48-a090-9b95ba01d27e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122189 Sep 15 09:14:07.240245 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 629/1197] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:14:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:14:07.392059 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:07.393388 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:14:07.401781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:07.402348 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:07.403342 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:07.403869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:07.612391 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:14:07.620628 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-774183e8-68ac-49d3-b8e1-8ccbca8cdf33 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1219 microversion: 2.1 time: 0.239064 Sep 15 09:14:07.621110 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 569/1198] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:14:07 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:14:08.643783 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:08.644462 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:14:08.652345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:08.652784 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:08.653534 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:08.653960 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:08.726354 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:08.726795 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:08.727231 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lazy-loading 'fault' on Instance uuid 7ce030c4-8a29-4653-b255-23c5b87cccd7 {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:14:08.787557 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70c39097c348466fab8594c9833ab11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f152a04b0f4546ba63efd155a1d010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:14:08.795131 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-1ca9f81b-7a21-4e6a-a010-d91a46b44391 tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 200 len: 1178 microversion: 2.1 time: 0.161152 Sep 15 09:14:08.795663 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 630/1199] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:14:08 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 1178 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:14:09.817741 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:09.818432 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] [instance: 7ce030c4-8a29-4653-b255-23c5b87cccd7] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:14:09.825623 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:09.826060 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:09.826860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:09.827288 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:09.879081 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] HTTP exception thrown: Instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 could not be found. Sep 15 09:14:09.879655 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Returning 404 to user: Instance 7ce030c4-8a29-4653-b255-23c5b87cccd7 could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:14:09.880457 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c68d37fd-2949-4f50-9e49-7ca60903fd6f tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7" status: 404 len: 111 microversion: 2.1 time: 0.071728 Sep 15 09:14:09.880967 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 570/1200] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:14:09 2021] GET /compute/v2.1/servers/7ce030c4-8a29-4653-b255-23c5b87cccd7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:14:10.181859 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6fb0db57-9802-4c47-9589-c12d2453f55c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] Calling method '.version_select at 0x7f1ec6797790>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:10.267549 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6fb0db57-9802-4c47-9589-c12d2453f55c tempest-TestShelveInstance-117007337 tempest-TestShelveInstance-117007337-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1146806295" status: 202 len: 0 microversion: 2.1 time: 0.094786 Sep 15 09:14:10.268105 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 631/1201] 10.222.0.39 () {58 vars in 1254 bytes} [Wed Sep 15 09:14:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1146806295 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 09:14:38.753182 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7cf1c6d4-cc2b-4771-a845-12cd31afdc8b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Action: 'create', calling method: .version_select at 0x7f1ec68b8c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-53678159"}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:14:38.780113 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-7cf1c6d4-cc2b-4771-a845-12cd31afdc8b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for project fa72fb70665242e7b7637379b4286d93. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:14:38.783944 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-7cf1c6d4-cc2b-4771-a845-12cd31afdc8b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for user a1448440c7854b35b3e0699bacf7eef5 and project fa72fb70665242e7b7637379b4286d93. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:14:38.962947 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-7cf1c6d4-cc2b-4771-a845-12cd31afdc8b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for project fa72fb70665242e7b7637379b4286d93. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:14:38.966547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-7cf1c6d4-cc2b-4771-a845-12cd31afdc8b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for user a1448440c7854b35b3e0699bacf7eef5 and project fa72fb70665242e7b7637379b4286d93. Resources: {'key_pairs'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:14:38.979965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7cf1c6d4-cc2b-4771-a845-12cd31afdc8b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.427138 Sep 15 09:14:38.980620 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 571/1202] 10.222.0.39 () {60 vars in 1158 bytes} [Wed Sep 15 09:14:38 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:14:58.529013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-749450840", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-53678159", "security_groups": [{"name": "tempest-secgroup-smoke-2144518127"}], "block_device_mapping_v2": [{"uuid": "8f3afd70-87c9-4e28-9b13-9f71fde29f6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6555b4f-8502-4e07-ad9a-5812cfe7a903"}]}} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:14:58.780640 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.network.neutron [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] validate_networks() for [('b6555b4f-8502-4e07-ad9a-5812cfe7a903', None, None, None)] {{(pid=89582) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:14:59.379371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Flavor limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:14:59.379787 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Image limits 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:14:59.380261 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Flavor pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:14:59.380661 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Image pref 0:0:0 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:14:59.381073 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.virt.hardware [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89582) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:14:59.390013 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:59.390482 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:59.391267 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:14:59.391705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:14:59.408392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for project fa72fb70665242e7b7637379b4286d93. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:14:59.412252 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.quota [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for user a1448440c7854b35b3e0699bacf7eef5 and project fa72fb70665242e7b7637379b4286d93. Resources: {'ram', 'instances', 'cores'} {{(pid=89582) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:14:59.509445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Going to run 1 instances... {{(pid=89582) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:14:59.511632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f3afd70-87c9-4e28-9b13-9f71fde29f6b',volume_size=None,volume_type=None)] {{(pid=89582) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:14:59.957147 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-fc743cfe-b176-4a2d-a028-01ac022b712a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.437152 Sep 15 09:14:59.958078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 632/1203] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:14:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 09:14:59.973356 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d15cf344-711b-4076-a6c2-012ac822bd47 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:14:59.974175 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d15cf344-711b-4076-a6c2-012ac822bd47 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:00.113879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d15cf344-711b-4076-a6c2-012ac822bd47 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:00.122053 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d15cf344-711b-4076-a6c2-012ac822bd47 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1092 microversion: 2.1 time: 0.157930 Sep 15 09:15:00.124595 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 572/1204] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:14:59 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1092 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:01.145686 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:01.146287 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:01.154308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:01.154754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:01.155514 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:01.155936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:01.285025 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:01.295423 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cf4ce37c-7bb9-44c9-b80c-b7919ebd9a2f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1142 microversion: 2.1 time: 0.159778 Sep 15 09:15:01.295962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 633/1205] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:01 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1142 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:02.317269 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:02.317860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:02.325737 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:02.326203 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:02.326969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:02.327392 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:02.464434 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:02.472454 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7fdb8d93-3bb0-4df0-843e-14922f0dcece tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1198 microversion: 2.1 time: 0.164267 Sep 15 09:15:02.472985 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 573/1206] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:02 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1198 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:03.496286 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:03.497043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:03.504744 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:03.505295 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:03.506153 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:03.506685 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:03.736763 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:03.746614 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-5f4b8259-3de1-4e0f-ad32-1878a5bebc29 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1276 microversion: 2.1 time: 0.260394 Sep 15 09:15:03.747563 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 634/1207] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:03 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:04.655941 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-f70af4c9-c03c-46ee-b2ff-cfb27f8650e4 req-47950191-16b5-4917-9f82-3593963fb240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fd1d50-46ee-466f-bb6c-b681bdb5d86d", "tag": "bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:15:04.662354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:15:04.662354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:15:04.678831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-f70af4c9-c03c-46ee-b2ff-cfb27f8650e4 req-47950191-16b5-4917-9f82-3593963fb240 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:04.678831 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-f70af4c9-c03c-46ee-b2ff-cfb27f8650e4 req-47950191-16b5-4917-9f82-3593963fb240 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:04.689705 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-f70af4c9-c03c-46ee-b2ff-cfb27f8650e4 req-47950191-16b5-4917-9f82-3593963fb240 service nova] Creating event network-changed:bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae for instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d on hv-cinder-80600 Sep 15 09:15:04.694428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-f70af4c9-c03c-46ee-b2ff-cfb27f8650e4 req-47950191-16b5-4917-9f82-3593963fb240 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047765 Sep 15 09:15:04.695018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 574/1208] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:15:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:15:04.770433 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:04.771674 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:04.779079 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:04.779767 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:04.780726 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:04.781155 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:04.986509 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:04.995747 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-254db6a4-545e-4a9e-8bae-c19a194cdcea tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.234847 Sep 15 09:15:04.996597 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 635/1209] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:04 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:06.022668 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:06.023397 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:06.034345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:06.034345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:06.034345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:06.034345 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:06.315889 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:06.324566 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2dfadff6-83d0-41c1-af59-a777b232fbe9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.313638 Sep 15 09:15:06.325086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 575/1210] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:06 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:07.347382 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:07.347965 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:07.355164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:07.355607 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:07.356385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:07.356813 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:07.560887 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:07.569005 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dd8373f3-e2b4-476a-8f28-57f89eb71c56 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.230767 Sep 15 09:15:07.569565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 636/1211] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:07 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:08.592089 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:08.592687 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:08.599913 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:08.600365 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:08.601122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:08.601556 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:08.801238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:08.809224 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-84181d0b-f5df-4ec8-aed9-92eeb6d4df30 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.226832 Sep 15 09:15:08.809757 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 576/1212] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:08 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:09.830956 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:09.831548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:09.839426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:09.839864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:09.840611 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:09.841034 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:10.036843 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:10.045590 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c37a122c-66f7-4871-9822-504c502c7b3c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.223687 Sep 15 09:15:10.046128 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 637/1213] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:09 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:11.067812 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:11.068415 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:11.075612 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:11.076048 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:11.076795 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:11.077216 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:11.272798 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:11.281157 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ea6c4f35-3477-481a-8d4b-e7b8346eb40a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.222820 Sep 15 09:15:11.281670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 577/1214] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:11 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:12.306882 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:12.307484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:12.315124 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:12.315562 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:12.316307 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:12.316729 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:12.514991 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:12.523157 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6aa42aa2-f05b-4527-a58a-5d772164792a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.228663 Sep 15 09:15:12.523672 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 638/1215] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:12 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:13.544787 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:13.545301 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:13.552564 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:13.552998 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:13.553748 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:13.554198 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:13.760473 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:13.768499 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-251d5d37-0caa-4b01-ac90-5c4f5b357502 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.232875 Sep 15 09:15:13.769031 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 578/1216] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:13 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:14.790206 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:14.790812 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:14.797932 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:14.798398 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:14.799150 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:14.799571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:15.005977 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:15.014434 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-16f33e18-7115-41cf-87ab-7058e0e7b016 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.233278 Sep 15 09:15:15.014951 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 639/1217] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:14 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:16.028655 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 09:15:16.037461 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:16.038062 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:16.045270 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:16.045714 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:16.046524 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:16.046951 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:16.167758 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-47c3a5aa-e1be-4cee-be7e-0da06b17b037 req-c835719a-c696-49b5-8d58-561e895c9a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fd1d50-46ee-466f-bb6c-b681bdb5d86d", "name": "network-vif-plugged", "status": "completed", "tag": "bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:15:16.174706 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:15:16.174706 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:15:16.183736 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-47c3a5aa-e1be-4cee-be7e-0da06b17b037 req-c835719a-c696-49b5-8d58-561e895c9a3c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:16.184299 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-47c3a5aa-e1be-4cee-be7e-0da06b17b037 req-c835719a-c696-49b5-8d58-561e895c9a3c service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:16.201511 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-47c3a5aa-e1be-4cee-be7e-0da06b17b037 req-c835719a-c696-49b5-8d58-561e895c9a3c service nova] Creating event network-vif-plugged:bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae for instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d on hv-cinder-80600 Sep 15 09:15:16.206439 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-47c3a5aa-e1be-4cee-be7e-0da06b17b037 req-c835719a-c696-49b5-8d58-561e895c9a3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161021 Sep 15 09:15:16.207325 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 640/1218] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:15:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:15:16.259847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:16.268008 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-73c208a8-64b6-46ad-890d-72777551a737 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.240753 Sep 15 09:15:16.268529 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 579/1219] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:16 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:17.282831 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 09:15:17.292586 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:17.293270 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:17.300698 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:17.301138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:17.301905 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:17.302358 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:17.499250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:17.507307 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-27c7140a-d328-4103-a05d-208ecb208bb4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1264 microversion: 2.1 time: 0.226002 Sep 15 09:15:17.507840 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 641/1220] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:17 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:18.529105 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:18.529646 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:18.548707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:18.549159 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:18.549954 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:18.550418 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:18.583446 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47450. Sep 15 09:15:18.748940 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:18.756946 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d4467d45-9a41-4871-8181-026232515543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1451 microversion: 2.1 time: 0.237049 Sep 15 09:15:18.757464 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 580/1221] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:18 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1451 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:18.778374 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:15:18.778979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:15:18.797670 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:18.798050 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:18.798840 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:18.799268 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:18.832803 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47454. Sep 15 09:15:19.002022 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:15:19.010041 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-9ba0797e-c8a4-4fb1-b751-4ecacbbf6e9d tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1451 microversion: 2.1 time: 0.241256 Sep 15 09:15:19.010601 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 642/1222] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:15:18 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1451 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:15:22.080907 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-2065260b-64f1-4889-8bbd-9e584c961311 req-b5b49a07-9ca7-4c5a-9a09-d8a724588454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fd1d50-46ee-466f-bb6c-b681bdb5d86d", "tag": "bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:15:22.087377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:15:22.087377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:15:22.095843 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-2065260b-64f1-4889-8bbd-9e584c961311 req-b5b49a07-9ca7-4c5a-9a09-d8a724588454 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:15:22.096281 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-2065260b-64f1-4889-8bbd-9e584c961311 req-b5b49a07-9ca7-4c5a-9a09-d8a724588454 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:15:22.112143 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-2065260b-64f1-4889-8bbd-9e584c961311 req-b5b49a07-9ca7-4c5a-9a09-d8a724588454 service nova] Creating event network-changed:bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae for instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d on hv-cinder-80600 Sep 15 09:15:22.117177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-2065260b-64f1-4889-8bbd-9e584c961311 req-b5b49a07-9ca7-4c5a-9a09-d8a724588454 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121202 Sep 15 09:15:22.118705 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 581/1223] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:15:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:17:16.476309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:16.476864 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:16.480427 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 09:17:16.480569 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:17:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d (ip 10.222.0.39) !!! Sep 15 09:17:16.491296 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 09:17:16.491421 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:17:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d (ip 10.222.0.39) !!! Sep 15 09:17:16.513650 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:16.514114 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:16.514865 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:16.515291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:16.581638 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Going to try to terminate instance {{(pid=89582) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:17:16.871206 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6f940522-0f95-46d2-83e5-db4ac7598f0f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 204 len: 0 microversion: 2.1 time: 0.403668 Sep 15 09:17:16.871776 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 643/1224] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:17:16 2021] DELETE /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:17:16.877602 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 15 09:17:16.878101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:17:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d (ip 10.222.0.39) !!! Sep 15 09:17:16.888275 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:17:16.889814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:17:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d (ip 10.222.0.39) !!! Sep 15 09:17:16.907240 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:16.907920 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:16.918600 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:16.919037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:16.919788 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:16.920211 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:17.122287 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:17.130517 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-358ffff5-3b4c-427a-ab9a-53cb66308d28 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1576 microversion: 2.1 time: 0.254297 Sep 15 09:17:17.131045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 582/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:16 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:18.153581 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:18.154291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:18.161471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:18.161907 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:18.162694 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:18.163113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:18.460461 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:18.468443 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-090c3fb4-ff6f-40d1-9cd3-5b76a04ebbfa tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1576 microversion: 2.1 time: 0.324499 Sep 15 09:17:18.468966 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 644/1226] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:18 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1576 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:19.491489 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:19.498205 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:19.500574 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:19.501025 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:19.501793 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:19.502284 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:19.680212 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:19.689109 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-5d0beb07-99da-4f1b-9210-602b7bca4af3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1508 microversion: 2.1 time: 0.207058 Sep 15 09:17:19.689929 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 583/1227] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:19 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:20.098713 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-c89ee9cd-66ad-4693-8563-cf55866e2f5c req-d17c4c19-0f4b-4f25-afb0-4dfb6b7f45b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fd1d50-46ee-466f-bb6c-b681bdb5d86d", "name": "network-vif-deleted", "tag": "bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:17:20.106419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:17:20.106419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:17:20.115001 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-c89ee9cd-66ad-4693-8563-cf55866e2f5c req-d17c4c19-0f4b-4f25-afb0-4dfb6b7f45b0 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:20.115441 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-c89ee9cd-66ad-4693-8563-cf55866e2f5c req-d17c4c19-0f4b-4f25-afb0-4dfb6b7f45b0 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:20.131754 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-c89ee9cd-66ad-4693-8563-cf55866e2f5c req-d17c4c19-0f4b-4f25-afb0-4dfb6b7f45b0 service nova] Creating event network-vif-deleted:bd7fc34f-4e7a-4dde-bcda-4e5bbb1015ae for instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d on hv-cinder-80600 Sep 15 09:17:20.136753 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-c89ee9cd-66ad-4693-8563-cf55866e2f5c req-d17c4c19-0f4b-4f25-afb0-4dfb6b7f45b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048971 Sep 15 09:17:20.137392 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 645/1228] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:17:20.710869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:20.711465 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:20.719126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:20.719561 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:20.720316 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:20.720736 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:20.925274 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:20.933918 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2b542cdb-5c3d-428d-9948-504ba5ed6cbf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 200 len: 1223 microversion: 2.1 time: 0.232153 Sep 15 09:17:20.942969 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 584/1229] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:20 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 1223 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:21.956967 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:21.957649 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:21.965479 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:21.965914 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:21.966705 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:21.967140 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:22.021458 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] HTTP exception thrown: Instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d could not be found. Sep 15 09:17:22.022043 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Returning 404 to user: Instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:17:22.022882 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d137b644-0bfb-40fd-8f6e-a976786761d2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 404 len: 111 microversion: 2.1 time: 0.075586 Sep 15 09:17:22.023425 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 646/1230] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:21 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:17:22.140782 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-917751669", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-53678159", "security_groups": [{"name": "tempest-secgroup-smoke-2144518127"}], "block_device_mapping_v2": [{"uuid": "8f3afd70-87c9-4e28-9b13-9f71fde29f6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6555b4f-8502-4e07-ad9a-5812cfe7a903"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:17:22.309476 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] validate_networks() for [('b6555b4f-8502-4e07-ad9a-5812cfe7a903', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:17:22.879788 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:17:22.880208 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:17:22.880673 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:17:22.881074 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:17:22.881477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:17:22.889704 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:22.890177 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:22.890968 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:22.891394 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:22.910814 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for project fa72fb70665242e7b7637379b4286d93. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:17:22.915195 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for user a1448440c7854b35b3e0699bacf7eef5 and project fa72fb70665242e7b7637379b4286d93. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:17:23.011721 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:17:23.013825 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f3afd70-87c9-4e28-9b13-9f71fde29f6b',volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:17:23.479993 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-79a2b800-54e3-4bf4-9177-75429cf2347c tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.349051 Sep 15 09:17:23.480632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 585/1231] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:17:22 2021] POST /compute/v2.1/servers => generated 406 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 09:17:23.496153 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-0b9f30eb-2b6b-49f4-8951-b883da4455df tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:23.496762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-0b9f30eb-2b6b-49f4-8951-b883da4455df tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:23.576811 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-0b9f30eb-2b6b-49f4-8951-b883da4455df tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:23.584126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-0b9f30eb-2b6b-49f4-8951-b883da4455df tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1092 microversion: 2.1 time: 0.097156 Sep 15 09:17:23.584632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 647/1232] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:23 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1092 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:17:24.606687 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-922da636-dfde-4e41-a10a-9e3b43c225c9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:24.607286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-922da636-dfde-4e41-a10a-9e3b43c225c9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:24.684566 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-922da636-dfde-4e41-a10a-9e3b43c225c9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:24.691796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-922da636-dfde-4e41-a10a-9e3b43c225c9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1092 microversion: 2.1 time: 0.094922 Sep 15 09:17:24.692358 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 586/1233] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:24 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1092 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:25.714152 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:25.714764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:25.722642 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:25.723091 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:25.723853 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:25.724287 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:25.842564 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:25.850454 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d0d53f4e-73b3-4e70-8466-8d491ac8a9c4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1142 microversion: 2.1 time: 0.145696 Sep 15 09:17:25.850982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 648/1234] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:25 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1142 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:26.873853 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:26.874576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:26.882265 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:26.882702 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:26.884109 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:26.884560 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:27.002217 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:27.010812 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-2ef3340a-972d-4b8d-bb8f-c8a2a5a7d19b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1134 microversion: 2.1 time: 0.146847 Sep 15 09:17:27.011351 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 587/1235] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:26 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1134 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:28.033836 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:28.034459 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:28.042029 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:28.042849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:28.043350 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:28.043779 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:28.167936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:28.176106 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-982ab58a-5f55-45bd-ab0a-98a6d7932591 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1208 microversion: 2.1 time: 0.152230 Sep 15 09:17:28.179196 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 649/1236] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:28 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1208 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:29.198201 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:29.198813 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:29.205869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:29.206350 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:29.207117 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:29.207549 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:29.721630 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:29.729781 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-4550fecc-516c-4242-9187-c0b3bc995913 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1276 microversion: 2.1 time: 0.540820 Sep 15 09:17:29.730340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 588/1237] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:29 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1276 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:29.891450 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-cf60f4d9-bf36-4f87-b36c-35a7501f305c req-a55ff34b-d8f3-4041-90e7-ff4286c4bd6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed07dfa5-d398-4be8-b546-85a264f2560e", "tag": "e9d6d25f-ee7d-4b80-a209-99e55deac0b8"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:17:29.899309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:17:29.899309 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:17:29.908352 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-cf60f4d9-bf36-4f87-b36c-35a7501f305c req-a55ff34b-d8f3-4041-90e7-ff4286c4bd6f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:29.909079 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-cf60f4d9-bf36-4f87-b36c-35a7501f305c req-a55ff34b-d8f3-4041-90e7-ff4286c4bd6f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:29.925679 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-cf60f4d9-bf36-4f87-b36c-35a7501f305c req-a55ff34b-d8f3-4041-90e7-ff4286c4bd6f service nova] Creating event network-changed:e9d6d25f-ee7d-4b80-a209-99e55deac0b8 for instance ed07dfa5-d398-4be8-b546-85a264f2560e on hv-cinder-80600 Sep 15 09:17:29.931078 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-cf60f4d9-bf36-4f87-b36c-35a7501f305c req-a55ff34b-d8f3-4041-90e7-ff4286c4bd6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051392 Sep 15 09:17:29.931681 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 650/1238] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:17:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:17:30.751375 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:30.751952 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:30.758993 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:30.759430 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:30.760179 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:30.760605 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:31.105074 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:31.113760 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-362a983b-b500-4bc3-a9dd-87ced9f28972 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.371617 Sep 15 09:17:31.114325 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 589/1239] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:30 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:32.137142 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:32.137863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:32.145317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:32.145759 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:32.146548 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:32.146979 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:32.348902 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:32.357728 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-33741302-e1c7-4e92-ab96-3a6171707295 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.230046 Sep 15 09:17:32.358283 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 651/1240] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:32 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:33.383495 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:33.384426 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:33.395603 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:33.396267 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:33.397417 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:33.398065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:33.619974 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:33.628234 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-bd8a8d4c-f02c-456e-a1a8-f8b75c6570c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.257746 Sep 15 09:17:33.633900 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 590/1241] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:33 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:34.650542 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:34.651156 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:34.658424 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:34.658873 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:34.659634 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:34.660070 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:34.860313 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:34.869138 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-c61884a4-99cd-49de-9e3e-f1526851015a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.227720 Sep 15 09:17:34.869665 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 652/1242] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:34 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:35.891665 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:35.892286 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:35.899436 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:35.899869 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:35.900621 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:35.901043 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:36.100944 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:36.109482 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d575aa87-1529-4131-929a-ec739d660162 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.227466 Sep 15 09:17:36.110009 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 591/1243] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:35 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:37.131067 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:37.131680 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:37.139416 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:37.139871 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:37.140750 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:37.141181 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:37.341118 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:37.348982 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-dbbf1e12-1dbe-468e-bac8-6ec2f36fbf73 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.227084 Sep 15 09:17:37.349512 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 653/1244] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:37 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:38.370955 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:38.371551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:38.378653 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:38.379090 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:38.379847 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:38.380266 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:38.581011 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:38.589610 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-85ca13f5-fb77-4d0e-bd10-83eaa07eaedf tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.227731 Sep 15 09:17:38.591092 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 592/1245] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:38 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:39.611933 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:39.612532 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:39.619877 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:39.620323 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:39.621087 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:39.621520 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:39.826250 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:39.834320 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-11b7b0f0-aa59-4c7e-941e-3fd706e51382 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.231839 Sep 15 09:17:39.834838 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 654/1246] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:39 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:40.720608 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-3b52e7fe-0ac5-4bd6-85db-98bddd4ebd3d req-c6a1d516-9c4d-41bc-b966-532d485b3bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed07dfa5-d398-4be8-b546-85a264f2560e", "name": "network-vif-plugged", "status": "completed", "tag": "e9d6d25f-ee7d-4b80-a209-99e55deac0b8"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:17:40.728326 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:17:40.728326 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:17:40.751045 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-3b52e7fe-0ac5-4bd6-85db-98bddd4ebd3d req-c6a1d516-9c4d-41bc-b966-532d485b3bb3 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:40.751480 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-3b52e7fe-0ac5-4bd6-85db-98bddd4ebd3d req-c6a1d516-9c4d-41bc-b966-532d485b3bb3 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:40.768328 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-3b52e7fe-0ac5-4bd6-85db-98bddd4ebd3d req-c6a1d516-9c4d-41bc-b966-532d485b3bb3 service nova] Creating event network-vif-plugged:e9d6d25f-ee7d-4b80-a209-99e55deac0b8 for instance ed07dfa5-d398-4be8-b546-85a264f2560e on hv-cinder-80600 Sep 15 09:17:40.773261 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-3b52e7fe-0ac5-4bd6-85db-98bddd4ebd3d req-c6a1d516-9c4d-41bc-b966-532d485b3bb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061789 Sep 15 09:17:40.776756 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 593/1247] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:17:40.857085 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:40.857889 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:40.865021 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:40.865471 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:40.866273 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:40.867331 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:41.066555 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:41.080186 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ade59511-eb34-4525-b563-9e0aac341098 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.232693 Sep 15 09:17:41.080734 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 655/1248] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:40 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:42.103093 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:42.103865 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:42.111774 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:42.112229 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:42.113037 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:42.113470 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:42.316307 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:42.324474 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-753b40bf-d9a1-4929-832a-ab6a45a62d96 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1264 microversion: 2.1 time: 0.230989 Sep 15 09:17:42.324990 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 594/1249] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:42 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:43.346933 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:43.347544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:43.354770 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:43.355225 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:43.355992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:43.356424 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:43.558568 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:43.566632 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f0d39df6-4067-45f3-a779-42337b2c0398 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1451 microversion: 2.1 time: 0.228832 Sep 15 09:17:43.567169 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 656/1250] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:43 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1451 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:43.589707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:17:43.590333 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:17:43.597423 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:43.597858 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:43.598651 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:43.599072 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:43.805753 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:17:43.813729 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c8ff69e4-7601-486e-912a-a777e6761cb6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1451 microversion: 2.1 time: 0.233177 Sep 15 09:17:43.814268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 595/1251] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:17:43 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1451 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:17:46.686194 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-70b3e7de-fc2c-4fa9-9817-842a4985d737 req-62427f3a-0ef6-40bd-9290-b9c5158039dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed07dfa5-d398-4be8-b546-85a264f2560e", "tag": "e9d6d25f-ee7d-4b80-a209-99e55deac0b8"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:17:46.692608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:17:46.692608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:17:46.701281 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-70b3e7de-fc2c-4fa9-9817-842a4985d737 req-62427f3a-0ef6-40bd-9290-b9c5158039dd service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:17:46.701714 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-70b3e7de-fc2c-4fa9-9817-842a4985d737 req-62427f3a-0ef6-40bd-9290-b9c5158039dd service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:17:46.717821 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-70b3e7de-fc2c-4fa9-9817-842a4985d737 req-62427f3a-0ef6-40bd-9290-b9c5158039dd service nova] Creating event network-changed:e9d6d25f-ee7d-4b80-a209-99e55deac0b8 for instance ed07dfa5-d398-4be8-b546-85a264f2560e on hv-cinder-80600 Sep 15 09:17:46.722742 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-70b3e7de-fc2c-4fa9-9817-842a4985d737 req-62427f3a-0ef6-40bd-9290-b9c5158039dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046029 Sep 15 09:17:46.723298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 657/1252] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:17:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:19:21.594126 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1289627901", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-53678159", "security_groups": [{"name": "tempest-secgroup-smoke-2144518127"}], "block_device_mapping_v2": [{"uuid": "34c041b9-ba90-4696-8393-de361494627e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6555b4f-8502-4e07-ad9a-5812cfe7a903"}]}} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:19:21.621018 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] AMQP server on 10.222.0.39:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 09:19:21.912882 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.network.neutron [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] validate_networks() for [('b6555b4f-8502-4e07-ad9a-5812cfe7a903', None, None, None)] {{(pid=89583) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Sep 15 09:19:22.508065 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Flavor limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Sep 15 09:19:22.508482 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Image limits 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Sep 15 09:19:22.508974 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Flavor pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Sep 15 09:19:22.509374 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Image pref 0:0:0 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Sep 15 09:19:22.509776 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.virt.hardware [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=89583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Sep 15 09:19:22.517873 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:22.518347 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:22.519675 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:22.520095 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:22.539631 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for project fa72fb70665242e7b7637379b4286d93. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 09:19:22.543539 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.quota [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Getting quotas for user a1448440c7854b35b3e0699bacf7eef5 and project fa72fb70665242e7b7637379b4286d93. Resources: {'ram', 'instances', 'cores'} {{(pid=89583) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 09:19:22.637755 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f78ce5c-b536-4d66-9a99-d8905e1776f0] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47654. Sep 15 09:19:22.642382 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Going to run 1 instances... {{(pid=89583) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Sep 15 09:19:22.645122 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='34c041b9-ba90-4696-8393-de361494627e',volume_size=None,volume_type=None)] {{(pid=89583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Sep 15 09:19:23.055138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-57887a86-3fc5-419e-8ef9-bfb43d7c82d6 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.470086 Sep 15 09:19:23.055754 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 596/1253] 10.222.0.39 () {60 vars in 1147 bytes} [Wed Sep 15 09:19:21 2021] POST /compute/v2.1/servers => generated 406 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 09:19:23.063298 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] AMQP server on 10.222.0.39:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 15 09:19:23.075164 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-cd429057-ab97-4763-9381-6a1c9e29937a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:23.075852 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-cd429057-ab97-4763-9381-6a1c9e29937a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:23.224571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-cd429057-ab97-4763-9381-6a1c9e29937a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:23.231998 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-cd429057-ab97-4763-9381-6a1c9e29937a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1093 microversion: 2.1 time: 0.170065 Sep 15 09:19:23.232531 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 658/1254] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:23 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1093 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:24.254932 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:24.255589 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:24.263291 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:24.263730 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:24.264545 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:24.264965 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:24.384336 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:24.392576 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-1abaf9e4-1276-4079-8fc9-fe3d0229b01e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1135 microversion: 2.1 time: 0.147237 Sep 15 09:19:24.393106 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 597/1255] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:24 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1135 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:25.435862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:25.435862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:25.435862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:25.435862 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:25.437131 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:25.437131 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:25.490466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa8a9add-7e0d-4f1a-9424-97b302c01040] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47676. Sep 15 09:19:25.559059 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:25.567576 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-8b8c232e-7b39-461e-9065-712beb78638e tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1209 microversion: 2.1 time: 0.162722 Sep 15 09:19:25.568110 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 659/1256] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:25 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:26.590611 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:26.591223 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:26.598405 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:26.598860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:26.599621 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:26.600046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:27.258509 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:27.266491 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-d0c3f013-723c-4c18-8229-7ff0a77d8a19 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1277 microversion: 2.1 time: 0.685769 Sep 15 09:19:27.267010 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 598/1257] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:26 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1277 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:27.488701 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-fc33c331-4c42-4845-a634-d81d326c788f req-6ba01cd5-59d1-4413-b8c8-b0bc534400ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4a9d37-48ee-47db-b94f-c4227c5e642f", "tag": "d36022d6-0fcf-4729-8b09-632319855f25"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:19:27.495385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:19:27.495385 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:19:27.503928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-fc33c331-4c42-4845-a634-d81d326c788f req-6ba01cd5-59d1-4413-b8c8-b0bc534400ac service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:27.504372 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-fc33c331-4c42-4845-a634-d81d326c788f req-6ba01cd5-59d1-4413-b8c8-b0bc534400ac service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:27.522484 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-fc33c331-4c42-4845-a634-d81d326c788f req-6ba01cd5-59d1-4413-b8c8-b0bc534400ac service nova] Creating event network-changed:d36022d6-0fcf-4729-8b09-632319855f25 for instance 7e4a9d37-48ee-47db-b94f-c4227c5e642f on hv-cinder-80600 Sep 15 09:19:27.527304 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-fc33c331-4c42-4845-a634-d81d326c788f req-6ba01cd5-59d1-4413-b8c8-b0bc534400ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139047 Sep 15 09:19:27.527892 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 660/1258] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:19:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:19:28.288951 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:28.289551 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:28.296728 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:28.297164 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:28.297925 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:28.298367 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:28.633238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:28.641204 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-65b86ed8-bf89-492a-af44-9cacecc87f50 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.362052 Sep 15 09:19:28.641737 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 599/1259] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:28 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:29.664113 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:29.664805 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:29.672326 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:29.672772 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:29.673537 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:29.673968 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:29.875490 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:29.884159 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2a6006a8-bd38-40c2-b048-3b4ecf25e5a5 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.230236 Sep 15 09:19:29.884690 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 661/1260] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:29 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:30.905735 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:30.906354 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:30.913525 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:30.913960 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:30.914744 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:30.915170 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:31.116991 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:31.125057 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7ab7acfc-baa5-4a2e-a439-5f3feb538895 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.228382 Sep 15 09:19:31.125606 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 600/1261] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:30 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:32.148338 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:32.148955 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:32.156193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:32.156636 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:32.157399 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:32.157827 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:32.358487 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:32.366479 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-65ac3801-3fbe-4f29-9e0f-e1ad42bd77c1 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.227954 Sep 15 09:19:32.367002 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 662/1262] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:32 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:33.388810 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:33.389398 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:33.397268 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:33.397707 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:33.398477 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:33.398904 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:33.598564 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:33.607134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-43051d30-fbb7-49dd-a106-001b211e0c0b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.227967 Sep 15 09:19:33.607657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 601/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:33 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:34.629453 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:34.630050 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:34.637150 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:34.637584 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:34.638369 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:34.638795 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:34.835466 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:34.843336 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-f94aa2c7-8cdc-4124-8938-2f27ea9c930b tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.223555 Sep 15 09:19:34.843863 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 663/1264] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:34 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:35.865463 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:35.866057 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:35.873112 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:35.873547 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:35.874350 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:35.874772 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:36.098134 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:36.106535 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b77e5a06-8252-4cb3-b735-499c940b98a9 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.250046 Sep 15 09:19:36.107142 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 602/1265] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:35 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:37.128936 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:37.129544 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:37.136981 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:37.137430 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:37.138226 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:37.138658 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:37.228148 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [req-2d91197e-0bda-4bc2-b568-8fb8948cc2b2 req-c021d575-0332-4e32-84fe-76a316d172a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4a9d37-48ee-47db-b94f-c4227c5e642f", "name": "network-vif-plugged", "status": "completed", "tag": "d36022d6-0fcf-4729-8b09-632319855f25"}]} {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:19:37.234811 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:19:37.234811 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: warnings.warn(msg) Sep 15 09:19:37.243390 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-2d91197e-0bda-4bc2-b568-8fb8948cc2b2 req-c021d575-0332-4e32-84fe-76a316d172a3 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:37.243826 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [req-2d91197e-0bda-4bc2-b568-8fb8948cc2b2 req-c021d575-0332-4e32-84fe-76a316d172a3 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:37.259486 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.compute.server_external_events [req-2d91197e-0bda-4bc2-b568-8fb8948cc2b2 req-c021d575-0332-4e32-84fe-76a316d172a3 service nova] Creating event network-vif-plugged:d36022d6-0fcf-4729-8b09-632319855f25 for instance 7e4a9d37-48ee-47db-b94f-c4227c5e642f on hv-cinder-80600 Sep 15 09:19:37.264485 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [req-2d91197e-0bda-4bc2-b568-8fb8948cc2b2 req-c021d575-0332-4e32-84fe-76a316d172a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046083 Sep 15 09:19:37.265082 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 603/1266] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:19:37.348751 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:37.357345 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-2b370d3d-cbec-47c9-9a1f-f8ec0cf880de tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.237934 Sep 15 09:19:37.357882 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 664/1267] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:37 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:38.380573 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:38.381259 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:38.388671 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:38.389115 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:38.389860 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:38.390338 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:38.591738 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:38.600285 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-ce0fbd8d-9339-437e-8fca-385fdd580ce8 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1265 microversion: 2.1 time: 0.229947 Sep 15 09:19:38.600816 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 604/1268] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:38 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:39.693895 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:39.694531 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:39.701590 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:39.702046 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:39.702900 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:39.703391 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:39.902426 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:39.910858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ebda25eb-8fd7-41ef-ac8b-2a50eda582f3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1451 microversion: 2.1 time: 0.296476 Sep 15 09:19:39.911414 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 665/1269] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:39 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1451 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:39.939756 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:19:39.940386 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:19:39.947649 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:39.948083 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:39.948837 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:39.949258 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:40.148402 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:19:40.156632 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-215972ff-d43f-4d58-87f7-082df46df543 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1451 microversion: 2.1 time: 0.234183 Sep 15 09:19:40.157155 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 605/1270] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:19:39 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:19:43.087952 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-32b0b978-80f8-4456-92d7-f06d00471914 req-2523e22e-f181-430c-bdd0-aafe3736c968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4a9d37-48ee-47db-b94f-c4227c5e642f", "tag": "d36022d6-0fcf-4729-8b09-632319855f25"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:19:43.094561 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:19:43.094561 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:19:43.102858 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-32b0b978-80f8-4456-92d7-f06d00471914 req-2523e22e-f181-430c-bdd0-aafe3736c968 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:19:43.103317 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-32b0b978-80f8-4456-92d7-f06d00471914 req-2523e22e-f181-430c-bdd0-aafe3736c968 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:19:43.122989 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-32b0b978-80f8-4456-92d7-f06d00471914 req-2523e22e-f181-430c-bdd0-aafe3736c968 service nova] Creating event network-changed:d36022d6-0fcf-4729-8b09-632319855f25 for instance 7e4a9d37-48ee-47db-b94f-c4227c5e642f on hv-cinder-80600 Sep 15 09:19:43.128496 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-32b0b978-80f8-4456-92d7-f06d00471914 req-2523e22e-f181-430c-bdd0-aafe3736c968 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050977 Sep 15 09:19:43.129786 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 666/1271] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:19:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:21:12.541120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:21:12.541120 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:21:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Sep 15 09:21:12.544980 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:12.545514 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:12.549377 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:21:12.549526 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: Wed Sep 15 09:21:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f (ip 10.222.0.39) !!! Sep 15 09:21:12.560992 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 09:21:12.561393 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: Wed Sep 15 09:21:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Sep 15 09:21:12.566631 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:12.567228 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:12.568137 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:12.568664 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:12.671032 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:21:12.678708 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-850ae116-e7bc-4fea-86b6-ac7195d47fd2 req-d9e73583-62c2-4219-83ee-21b8f2330b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4a9d37-48ee-47db-b94f-c4227c5e642f", "tag": "d36022d6-0fcf-4729-8b09-632319855f25"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:21:12.684962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:21:12.684962 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:21:12.694608 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-850ae116-e7bc-4fea-86b6-ac7195d47fd2 req-d9e73583-62c2-4219-83ee-21b8f2330b1d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:12.695052 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-850ae116-e7bc-4fea-86b6-ac7195d47fd2 req-d9e73583-62c2-4219-83ee-21b8f2330b1d service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:12.711173 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-850ae116-e7bc-4fea-86b6-ac7195d47fd2 req-d9e73583-62c2-4219-83ee-21b8f2330b1d service nova] Creating event network-changed:d36022d6-0fcf-4729-8b09-632319855f25 for instance 7e4a9d37-48ee-47db-b94f-c4227c5e642f on hv-cinder-80600 Sep 15 09:21:12.717312 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-850ae116-e7bc-4fea-86b6-ac7195d47fd2 req-d9e73583-62c2-4219-83ee-21b8f2330b1d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182732 Sep 15 09:21:12.718291 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 667/1272] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:21:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:21:12.981160 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-04d17e4c-33a7-4d24-a7b4-f9a9e3b193e2 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 204 len: 0 microversion: 2.1 time: 0.448332 Sep 15 09:21:12.982196 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 606/1273] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:21:12 2021] DELETE /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:21:12.996849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:12.997928 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:13.006378 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:13.006919 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:13.007924 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:13.008527 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:13.340464 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:21:13.348809 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-48f6b884-319a-495e-be2e-495688bbbff0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1576 microversion: 2.1 time: 0.362017 Sep 15 09:21:13.349349 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 668/1274] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:12 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1576 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:21:14.371879 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:14.372565 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:14.380238 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:14.380679 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:14.381428 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:14.381846 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:14.585289 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:21:14.593298 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-faa3796e-8575-4a0e-bf67-91e6dbbd37e4 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1457 microversion: 2.1 time: 0.231236 Sep 15 09:21:14.593821 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 607/1275] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:14 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1457 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:21:15.586855 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-08023369-304c-4c7c-ba0e-fc42b7f48109 req-c76fbef0-b421-485e-9169-2176f5d1859f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4a9d37-48ee-47db-b94f-c4227c5e642f", "name": "network-vif-deleted", "tag": "d36022d6-0fcf-4729-8b09-632319855f25"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:21:15.593170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:21:15.593170 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:21:15.601689 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-08023369-304c-4c7c-ba0e-fc42b7f48109 req-c76fbef0-b421-485e-9169-2176f5d1859f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:15.602157 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-08023369-304c-4c7c-ba0e-fc42b7f48109 req-c76fbef0-b421-485e-9169-2176f5d1859f service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:15.617778 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-08023369-304c-4c7c-ba0e-fc42b7f48109 req-c76fbef0-b421-485e-9169-2176f5d1859f service nova] Creating event network-vif-deleted:d36022d6-0fcf-4729-8b09-632319855f25 for instance 7e4a9d37-48ee-47db-b94f-c4227c5e642f on hv-cinder-80600 Sep 15 09:21:15.621443 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:15.621975 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:15.622565 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-08023369-304c-4c7c-ba0e-fc42b7f48109 req-c76fbef0-b421-485e-9169-2176f5d1859f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045383 Sep 15 09:21:15.623134 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 669/1276] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:21:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:21:15.628911 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:15.629349 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:15.630138 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:15.630564 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:16.103086 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:21:16.111827 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-b1c2d6b8-33e1-4841-a78c-ee551cf60069 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 200 len: 1389 microversion: 2.1 time: 0.499821 Sep 15 09:21:16.112657 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 608/1277] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:15 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 1389 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:21:17.135048 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:17.135780 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: 7e4a9d37-48ee-47db-b94f-c4227c5e642f] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:17.143126 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:17.143571 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:17.144334 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:17.144762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:17.194401 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] HTTP exception thrown: Instance 7e4a9d37-48ee-47db-b94f-c4227c5e642f could not be found. Sep 15 09:21:17.194999 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Returning 404 to user: Instance 7e4a9d37-48ee-47db-b94f-c4227c5e642f could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:21:17.195826 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-872a22d0-614d-4a67-a049-7740f1126cd0 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f" status: 404 len: 111 microversion: 2.1 time: 0.070806 Sep 15 09:21:17.196400 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 670/1278] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:17 2021] GET /compute/v2.1/servers/7e4a9d37-48ee-47db-b94f-c4227c5e642f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:21:21.367204 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:21.367736 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:21.368980 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-168654d5-fd59-425a-a002-a51130c549c5 req-9a26c0ff-96bb-4f99-9834-65e62f2a9865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed07dfa5-d398-4be8-b546-85a264f2560e", "tag": "e9d6d25f-ee7d-4b80-a209-99e55deac0b8"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:21:21.375360 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:21.375534 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:21:21.375534 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:21:21.375818 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:21.376737 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:21.377250 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:21.383404 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-168654d5-fd59-425a-a002-a51130c549c5 req-9a26c0ff-96bb-4f99-9834-65e62f2a9865 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:21.383849 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-168654d5-fd59-425a-a002-a51130c549c5 req-9a26c0ff-96bb-4f99-9834-65e62f2a9865 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:21.400040 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-168654d5-fd59-425a-a002-a51130c549c5 req-9a26c0ff-96bb-4f99-9834-65e62f2a9865 service nova] Creating event network-changed:e9d6d25f-ee7d-4b80-a209-99e55deac0b8 for instance ed07dfa5-d398-4be8-b546-85a264f2560e on hv-cinder-80600 Sep 15 09:21:21.404764 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-168654d5-fd59-425a-a002-a51130c549c5 req-9a26c0ff-96bb-4f99-9834-65e62f2a9865 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044689 Sep 15 09:21:21.405561 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 671/1279] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:21:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 09:21:21.444983 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Going to try to terminate instance {{(pid=89583) delete /opt/stack/nova/nova/compute/api.py:2559}} Sep 15 09:21:21.775058 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-7367e0f3-a541-460f-b236-d769bce5765a tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 204 len: 0 microversion: 2.1 time: 0.416462 Sep 15 09:21:21.775865 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 609/1280] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:21:21 2021] DELETE /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 09:21:21.790179 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:21.794733 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:21.798762 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:21.799210 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:21.799988 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:21.800419 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:22.097518 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:21:22.109788 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-6f0f4ece-0501-4f0a-a055-0da03ba6da69 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1576 microversion: 2.1 time: 0.329563 Sep 15 09:21:22.111603 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 672/1281] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:21 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1576 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:21:23.133670 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:23.134949 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:23.142263 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:23.142712 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:23.143488 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:23.143917 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:23.341796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:21:23.349787 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-c76d87ed-ec5b-477f-a394-47bc63770f54 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1457 microversion: 2.1 time: 0.225766 Sep 15 09:21:23.350340 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 610/1282] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:23 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1457 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:21:24.344187 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [req-c595a3d3-9a42-48a5-8785-2e33b97250df req-202ebc5b-056a-40b0-9bbb-31093b4be103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed07dfa5-d398-4be8-b546-85a264f2560e", "name": "network-vif-deleted", "tag": "e9d6d25f-ee7d-4b80-a209-99e55deac0b8"}]} {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 09:21:24.351253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 09:21:24.351253 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: warnings.warn(msg) Sep 15 09:21:24.359443 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-c595a3d3-9a42-48a5-8785-2e33b97250df req-202ebc5b-056a-40b0-9bbb-31093b4be103 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:24.359873 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [req-c595a3d3-9a42-48a5-8785-2e33b97250df req-202ebc5b-056a-40b0-9bbb-31093b4be103 service nova] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:24.372197 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:24.372743 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:24.376009 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.compute.server_external_events [req-c595a3d3-9a42-48a5-8785-2e33b97250df req-202ebc5b-056a-40b0-9bbb-31093b4be103 service nova] Creating event network-vif-deleted:e9d6d25f-ee7d-4b80-a209-99e55deac0b8 for instance ed07dfa5-d398-4be8-b546-85a264f2560e on hv-cinder-80600 Sep 15 09:21:24.380101 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:24.380543 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:24.381079 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [req-c595a3d3-9a42-48a5-8785-2e33b97250df req-202ebc5b-056a-40b0-9bbb-31093b4be103 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Sep 15 09:21:24.381370 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:24.381643 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 673/1283] 10.222.0.39 () {64 vars in 1318 bytes} [Wed Sep 15 09:21:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 09:21:24.381796 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:24.601899 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.policy [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89583) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:21:24.611111 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-671625ce-cbeb-496e-b35d-c64ebdfdb120 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1389 microversion: 2.1 time: 0.248086 Sep 15 09:21:24.612128 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 611/1284] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:24 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1389 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 09:21:25.634377 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:25.635073 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:25.642718 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:25.643167 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:25.643938 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:25.644371 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:25.717236 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:25.717682 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:25.718155 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.objects.instance [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lazy-loading 'fault' on Instance uuid ed07dfa5-d398-4be8-b546-85a264f2560e {{(pid=89582) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 09:21:25.781233 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.policy [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1448440c7854b35b3e0699bacf7eef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa72fb70665242e7b7637379b4286d93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=89582) authorize /opt/stack/nova/nova/policy.py:222}} Sep 15 09:21:25.790160 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-d8d37d55-e970-406d-870a-b2bbb8636a42 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 200 len: 1228 microversion: 2.1 time: 0.165389 Sep 15 09:21:25.790621 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 674/1285] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:25 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 1228 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 09:21:26.811986 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:26.812582 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: ed07dfa5-d398-4be8-b546-85a264f2560e] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:26.820470 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:26.820908 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:26.821656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:26.822078 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:26.870323 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] HTTP exception thrown: Instance ed07dfa5-d398-4be8-b546-85a264f2560e could not be found. Sep 15 09:21:26.870898 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Returning 404 to user: Instance ed07dfa5-d398-4be8-b546-85a264f2560e could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:21:26.871688 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-f48e4603-5636-47e3-a84f-7bd03ef106d3 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e" status: 404 len: 111 microversion: 2.1 time: 0.068658 Sep 15 09:21:26.872189 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 612/1286] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:26 2021] GET /compute/v2.1/servers/ed07dfa5-d398-4be8-b546-85a264f2560e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 09:21:27.731027 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:27.731582 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.compute.api [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89582) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:27.738578 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:27.739016 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:27.739769 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:27.740193 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG oslo_concurrency.lockutils [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:27.789008 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.wsgi [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] HTTP exception thrown: Instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d could not be found. Sep 15 09:21:27.789599 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Returning 404 to user: Instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d could not be found. {{(pid=89582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:21:27.790445 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-ef69e09e-af9e-4e06-a0c9-29beececb655 tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 404 len: 111 microversion: 2.1 time: 0.068891 Sep 15 09:21:27.790978 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 675/1287] 10.222.0.39 () {58 vars in 1239 bytes} [Wed Sep 15 09:21:27 2021] DELETE /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:21:27.804055 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '>' {{(pid=89583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:27.804656 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.compute.api [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] [instance: e0fd1d50-46ee-466f-bb6c-b681bdb5d86d] Fetching instance by UUID {{(pid=89583) get /opt/stack/nova/nova/compute/api.py:2810}} Sep 15 09:21:27.811791 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:27.812237 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:27.813001 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 09:21:27.813433 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG oslo_concurrency.lockutils [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Lock "3e240028-fead-427e-81eb-96ea8b8203bc" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 09:21:27.862663 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.wsgi [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] HTTP exception thrown: Instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d could not be found. Sep 15 09:21:27.863242 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: DEBUG nova.api.openstack.wsgi [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Returning 404 to user: Instance e0fd1d50-46ee-466f-bb6c-b681bdb5d86d could not be found. {{(pid=89583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Sep 15 09:21:27.864046 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: INFO nova.api.openstack.requestlog [None req-66863efb-5106-43e6-a016-dc7c090211ed tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d" status: 404 len: 111 microversion: 2.1 time: 0.068907 Sep 15 09:21:27.864555 dv-cinder-806008-2-iscsi devstack@n-api.service[89583]: [pid: 89583|app: 0|req: 613/1288] 10.222.0.39 () {58 vars in 1236 bytes} [Wed Sep 15 09:21:27 2021] GET /compute/v2.1/servers/e0fd1d50-46ee-466f-bb6c-b681bdb5d86d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 09:21:29.617487 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: DEBUG nova.api.openstack.wsgi [None req-a5c8d486-6221-44e0-8cd3-4bfa5494ab4f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] Calling method '.version_select at 0x7f1ec6415c10>' {{(pid=89582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 09:21:29.714308 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: INFO nova.api.openstack.requestlog [None req-a5c8d486-6221-44e0-8cd3-4bfa5494ab4f tempest-TestVolumeBootPattern-2086294117 tempest-TestVolumeBootPattern-2086294117-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-53678159" status: 202 len: 0 microversion: 2.1 time: 0.105708 Sep 15 09:21:29.714829 dv-cinder-806008-2-iscsi devstack@n-api.service[89582]: [pid: 89582|app: 0|req: 676/1289] 10.222.0.39 () {58 vars in 1257 bytes} [Wed Sep 15 09:21:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-53678159 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)